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NOTICE 


THIS  DOCUMENT  IS  FOR  INFORMATION  AND  GUIDANCE  ONLY 

This  document  is  furnished  for  information  and  general  guidance  only.  It  is  not  to  be 
construed  as  a  request  for  proposals,  nor  as  a  commitment  by  the  Government  to  issue  a 
contract,  nor  as  authority  from  the  undersigned  to  incur  expenses  in  anticipation  of  a 
Government  contract;  nor  is  it  to  be  used  as  the  basis  of  a  claim  against  the  Government. 
The  furnishing  of  this  document  by  the  Government  is  not  to  be  construed  to  obligate  the 
organization  that  receives  it  to  furnish  to  the  United  States  Government  any  experimental, 
developmental,  research,  or  production  articles,  services,  or  proposals,  or  comment  with 
respect  to  such  documents,  the  Research  and  Technology  Plan,  or  any  aspects  regarding 
these. 

This  report  was  prepared  by  the  Special  Projects  Office,  HQ  Air  Force  Human  Resources 
Laboratory  (AFSC),  Brooks  Air  Force  Base,  Texas  78235-5601,  and  this  report  has  been 
reviewed  by  the  Office  of  Public  Affairs  (PA).  It  is  releasable  to  the  National  Technical 
Information  Service  (NTIS).  At  NTIS,  it  will  be  available  to  the  general  public,  including  foreign 
nationals. 

This  technical  report  has  been  reviewed  and  is  approved  for  publication. 


HERBERT  J.  CLARK,  Director 
Special  Projects  Office 


HAROLD  G.  JENSEN.  Colonel,  USAF 
Commander 
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PREFACE 


The  Air  Force  Human  Resources  Laboratory  (AFHRL)  is  part  of  the  Human  Systems 
Division  (H$D),  one  of  six  product  divisions  within  Air  Force  Systems  Command  (AFSC). 
The  official  plans  for  AFHRL  are  contained  in  the  FY  90  Human  Systems  Division  Technology 
Area  Plan  (TAP).  The  TAP  is  available  only  to  qualified  Government  personnel. 

This  document  contains  detailed  information  about  AFHRL  plans  at  the  laboratory  division 
level.  These  plans  are  a  subset  of  the  HSD  Technology  Area  Plan.  Detailed  funding 
information  has  not  been  included  in  this  plan  so  that  the  plan  may  be  made  available  to  the 
widest  possible  audience.  The  plan  is  specifically  designed  for  contractors  and  requirements 
managers  who  need  detailed  information  about  plans  of  specific  AFHRL  divisions. 
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I.  AFHRL  CHAIN  OF  COMMAND 

THE  DEPARTMENT  OF  THE  AIR  FORCE 

The  mission  of  the  Department  of  the  Air  Force  is  to  provide  an  Air 
Force  that  is  capable,  in  conjunction  with  the  other  Armed  Forces,  of 
preserving  the  peace  and  security  of  the  United  States. 


AIR  FORCE  SYSTEMS  COMMAND 

Major  Commands  are  interrelated  and  complementary,  providing 
offensive,  defensive,  and  support  elements.  Each  support  function, 
such  as  logistics,  training,  and  research  and  development,  is  under  the 
jurisdiction  of  a  separate  command.  Air  Force  Systems  Command 
(AFSC)  is  one  such  command.  Under  policies  established  by  HQ 
USAF,  AFSC’s  mission  is  to  advance  aerospace  technology,  to  incor¬ 
porate  those  advances  in  the  development  and  improvement  of 
aerospace  systems,  and  to  acquire  qualitatively  superior,  cost-effec¬ 
tive,  and  logistically  supported  aerospace  systems  and  equipment.  It 
is  through  AFSC  that  USAF’s  operational  and  support  commands 
receive  the  weapons,  equipment,  and  initial  spare  parts  needed  to 
defend  the  nation. 


AIR  FORCE  HUMAN  SYSTEMS  DIVISION 

The  Human  Systems  Division  (HSD)  is  a  product  division  under  AFSC. 
HSD  plans,  manages,  and  conducts  research,  engineering  develop¬ 
ment,  and  acquisition  programs  and  provides  specialized  operational 
support.  Its  efforts  focus  on  the  readiness,  maintenance,  protection 
and  enhancement  of  human  capabilities  and  human  system  perfor¬ 
mance  of  individuals,  teams,  crews,  and  force  levels.  It  serves  as  a 
center  for  human  systems  advocacy,  enabling  the  Air  Force  to  meet 
current  and  future  operational  requirements  in  the  four  functional  areas 
of  crew-system  integration,  crew  protection,  force  readiness  and  en¬ 
vironmental  protection. 


AIR  FORCE  HUMAN  RESOURCES  LABORATORY 

The  Air  Force  Human  Resources  Laboratory  (AFHRL),  is  one  of  four 
HSD  Laboratories.  It  manages  and  conducts  research,  exploratory,  and 
advanced  development  programs  in  manpower  and  personnel,  flying 
and  technical  training,  simulation,  and  logistics.  The  overall  goal  of  the 
combined  programs  is  to  help  the  Air  Force  achieve  the  best  methods 
for  acquiring  enlisted  and  officer  personnel,  and  training  and  maintain¬ 
ing  this  force  at  peak  readiness. 
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II.  HOW  TO  USE  THIS  DOCUMENT 

Unsolicited  proposals  to  conduct  research  leading  to  the  attainment  of  any  of  the  objectives  presented  in 
this  document  may  be  submitted  directly  to  an  Air  Force  laboratory.  However,  before  submitting  a  formal 
proposal,  we  encourage  you  to  discuss  your  approach  with  the  laboratory  point  of  contact.  After  such 
discussion  or  correspondence,  you  will  be  better  prepared  to  write  your  proposal. 

As  you  read  through  the  pages  that  follow,  you  may  see  a  field  of  endeavor  where  your  organization  can 
contribute  to  the  achievement  of  a  specific  technical  goal.  If  such  is  the  case,  you  are  invited  to  discuss  the 
objective  with  the  scientist  or  engineer  identified  with  the  objective.  Further,  you  may  have  completely  new 
ideas  not  considered  in  this  document  which,  if  brought  to  the  attention  of  the  proper  organization,  can  make 
a  significant  contribution  to  our  military  technology.  We  will  always  maintain  an  open  mind  in  evaluating  any 
new  concepts  which,  when  successfully  pursued,  would  improve  our  future  operational  capability. 

As  stated  in  AFSC  Pamphlet  70-5,  AFSC  Guide  for  Unsolicited  Proposals  (Private  industry  may  purchase 
the  pamphlets  for  approximately  $3.50  from:  Command  Publications  Distribution  Center,  HQ  AFSC/DAPPD, 
Andrews  AFB  DC  20334-5000),  elaborate  brochures  or  presentations  are  not  desired.  The  "ABCs"  of 
successful  proposals  are  accuracy,  brevity,  and  clarity.  It  is  important  that  your  letter  be  prepared  clearly  so 
it  imparts  an  appreciation  of  the  ideas  you  desire  to  convey.  Specifically,  your  letter  should  include  the 
following: 

1 .  Name  and  address  of  your  organization. 

2.  Type  of  organization  (profit,  nonprofit). 

3.  Concise  title  and  an  abstract  of  the  proposed  research,  and  a  statement  indicating  the  submission  of 
an  unsolicited  proposal. 

4.  Outline  and  discussion  of  the  purpose  of  the  research,  the  method  of  attack  on  the  problem,  and  the 
nature  of  the  expected  proposal. 

5.  Name  and  research  experience  of  the  principal  investigator. 

6.  Suggestion  as  to  the  proposed  starting  and  completion  dates. 

7.  Outline  of  the  proposed  budget,  including  information  on  equipment,  facility,  and  personnel  require¬ 
ments. 

8.  Names  of  any  other  Federal  agencies  receiving  the  proposal.  (This  is  extremely  important.) 

9.  Brief  description  of  your  facilities,  particularly  those  that  would  be  used  in  your  proposed  research 
effort. 

10.  Brief  outline  of  your  previous  work  and  experience  in  the  field. 

11.  Descriptive  brochures  and  financial  statements,  if  these  are  available. 
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III.  LABORATORY  MISSION  AND 
INVESTMENT  STRATEGY 

The  Air  Force  Human  Resources  Laboratory 
(AFHRL)  is  the  principal  Air  Force  Systems  Com¬ 
mand  (AFSC)  organization  charged  with  planning 
and  executing  the  USAF  exploratory  and  advanced 
development  programs  for  research  related  to  man¬ 
power  and  force  management,  logistics  systems 
technology,  and  training  technology.  Manpower 
and  force  management  research  and  development 
(R&D)  addresses  selection,  classification,  assign¬ 
ment,  evaluation,  and  retention  of  Air  Force  mem¬ 
bers  and  overall  force  structure  and  utilization. 
Logistics  systems  R&D  is  concerned  with  logistics 
factors  at  each  step  in  the  development  and  acquisi¬ 
tion  of  systems  and  the  productivity  of  maintenance 
teams.  Training  technology  R&D  addresses  the 
development  of  improved  methods  for  training,  in¬ 
cluding  content,  instructional  strategies,  delivery, 
evaluation,  and  management.  Aircrew  training  R&D 
includes  manned  aircraft  simulation,  performance 
measurement,  training  technology  for  air  combat 
tactics,  and  advanced  systems  to  improve  the 
quality  and  combat  effectiveness  of  aircrews.  Com¬ 
mand  and  control  (C2)  R&D  includes  training  to 
improve  team  performance,  C2  team  performance 
assessment,  and  information  systems  to  facilitate 
team  performance.  Technical  training  R&D  in¬ 
cludes  the  use  of  computer-assisted  methods  to 
improve  training  systems,  instructional  and  learning 
strategies,  techniques  for  managing  training,  an^ 
techniques  for  evaluating  job  performance. 

The  goal  of  the  AFHRL  investment  strategy  is  to 
help  ensure  combat  success  by  optimizing  human 
performance.  This  human-oriented  approach  is 
based  on  an  increasing  awareness  that  complex 
systems  require  detailed  identification  and  training 
of  personnel  for  operations,  maintenance,  and  sup¬ 
port. 

The  investment  strategy  at  AFHRL  considers: 

1 .  The  development  of  new  technologies  to  meet 
specific  weapon  system  needs. 

2.  Integration  of  Manpower,  Personnel,  and  T rain¬ 
ing  (MPT)  technologies  early  in  the  weapon  system 
acquisition  cycle. 


3.  Adherence  to  a  balance  between  technology 
development  and  technology  application  in  support 
of  customer  requirements. 

4.  Capitalization  on  emerging  technologies  which 
directly  impact  the  formulation  and  accomplishment 
of  the  R&D  program.  Examples  of  these  tech¬ 
nologies  are  artificial  intelligence,  miniaturized  com¬ 
puter  hardware,  sophisticated  software,  visual 
display  technologies,  and  weapon  system  design 
technologies. 

5.  Review  of  the  above  considerations  in  the  larger 
context  of  support  to  the  total  Human  Systems 
Division  (HSD),  AFSC,  and  the  Air  Force  mission. 

Investment  strategy  is  also  impacted  by  formal 
long-range  planning  guidance  such  as  Air  Force 
2000,  Air  Force-endorsed  Defense  Science  Board 
studies  and  recommendations,  Air  Force  Logistics 
Long  Range  Planning  Guide,  and  other  require¬ 
ments  levied  by  the  Air  Force.  Program  guidance  is 
provided  periodically  by  both  HQ  AFSC  and  HQ 
HSD. 

AFHRL  assigns  R&D  priorities  based  on  customer 
requirements,  technical  merit,  and  promise  of  tech¬ 
nology  transition  to  other  Air  Force  organizations. 

1 .  Requirement  evaluations  are  influenced  by  the 
urgency  of  the  proposed  R&D.  Mission  suitability  is 
an  important  part  of  the  requirements  evaluation 
process;  i.e.,  the  proposed  work  must  qualify  as 
R&D  and  fall  within  AFHRL’s  mission  area  respon¬ 
sibilities.  Requirements  are  high  priority  if  there  is 
considerable  Congressional-  or  general-officer- 
level  interest  in  the  program  and  the  work  is  formally 
required  by  regulation  or  agreement.  Even  without 
such  impetus,  priority  is  also  still  high  if  safety,  cost, 
or  combat  effectiveness  would  be  adversely  af¬ 
fected  if  the  R&D  were  not  conducted. 

2.  Technical  Merit  evaluations  are  influenced  by 
the  technical  feasibility  and  timeliness  of  the 
proposed  R&D,  the  clarity  of  the  R&D  objectives,  the 
quality  of  the  plans,  and  the  potential  uses  of  the 
R&D  products  in  other  efforts.  Consideration  is  also 
given  to  AFHRL’s  need  for  research  "tools." 

3.  Technology  Transition  of  the  R&D  product  to 
Air  Force  decision  makers  is  also  important.  AFHRL 
seeks  to  transfer  technology  to  those  who  need  it, 


3 


and  makes  the  information  available  to  Air  Force 
decision  makers  in  a  timely  fashion. 

Areas  of  Increasing  and  Decreasing  Emphasis. 
During  FY  90-95,  R&D  in  the  areas  of  Manpower, 
Personnel,  and  Training  (MPT)  integration  and 
aircrew  selection  will  expand.  Emphasis  on  the 
Armed  Services  Vocational  Aptitude  Battery  will 
decrease,  because  responsibility  has  been  trans¬ 
ferred  to  the  Defense  Manpower  Data  Center 
(DMDC)  in  Monterey,  California.  In  the  area  of  logis¬ 
tics  technology,  increased  emphasis  will  be  given  to 
two  6.3  projects  during  FY  90-91 :  Simultaneous 
Engineering  (SE)  and  Integrated  Maintenance  Infor¬ 
mation  System  (IMIS).  The  work  on  IMIS  will  then 
gradually  decrease  as  the  technology  is  transitioned 
to  user  organizations.  In  the  area  of  training  tech¬ 
nology,  increased  emphasis  will  be  given  to  multi¬ 
ship  aircrew  training  and  intelligent 
computer-assisted  instruction.  Decreased  em¬ 
phasis  will  be  given  to  traditional  forms  of  computer- 
based  training  and  instructional  support  systems,  as 
industry  can  already  meet  most  of  our  needs  in 
these  areas. 

Planning  and  Programming  Cycle.  Advance  plan¬ 
ning  is  the  primary  method  of  assuring  that  R&D 
resources  are  invested  in  technologies  that  meet  the 
needs  of  the  Air  Force  in  a  timely  manner.  The 
AFHRL  Investment  Strategy  is  implemented  through 
a  planning  and  programming  process  which  is  or¬ 
ganized  around  the  Department  Of  Defense  (DOD) 
Planning,  Programming,  and  Budgeting  System 
(PPBS).  Although  new  ideas  are  always  welcome 
and  will  be  considered  at  any  time,  the  following 
activities  constitute  the  preferred  AFHRL  planning 
cycle: 


1 .  Thirty-three  months  in  advance  of  the  fiscal  year 
in  which  an  effort  will  start,  division  scientists 
prepare  individual  work  unit  proposals.  Each 
proposal  identifies  and  justifies  the  R&D  being 
proposed,  provides  detail  on  the  technical  ap¬ 
proach,  and  specifies  the  technology  to  be  ad¬ 
vanced,  or  the  customer  requirement  to  be  satisfied. 

2.  Proposals  are  reviewed  by  the  Laboratory  Com¬ 
mander  and  are  tentatively  approved  if  they  comply 
with  the  investment  strategy  criteria  given  above. 
Other  reviews  may  be  conducted  by  the  AFHRL 
Technical  Advisory  Board  or  by  a  Research  Ad¬ 
visory  Panel  of  nationally  recognized  experts.  While 
these  reviews  are  ongoing,  the  need  for  front-end 
analysis  is  evaluated  by  the  staff  of  the  Special 
Projects  Office.  When  necessary,  formal  front-end 
analyses  (FEAs)  of  major  programs  are  completed 
and  incorporated  into  the  review  and  approval 
process.  Policies  guiding  FEAs  are  contained  in 
AFHRLR  173-1,  Front  End  Analysis  (FEA)  Studies. 

3.  After  preliminary  reviews  are  completed, 
AFHRL  scientists  develop  work  unit  packages  in 
compliance  with  AFHRLR  80-4,  Laboratory  Work 
Unit  Planning,  Prioritization,  Approval,  and  Comple¬ 
tion  Procedures. 

4.  The  final  review  authorizing  a  new  start  is  made 
by  the  Commander  before  the  proposed  program 
start.  Approval  is  based  on  the  merit  of  the 
proposal,  priority  of  the  program,  and  availability  of 
resources. 
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IV.  BASIC  RESEARCH  PROGRAMS 

(6.1) 

AFHRL  conducts  basic  research  under  two  Ai- 
Force  Office  of  Scientific  Research  (AFOSR)  tasks: 
(a)  Manpower  Management,  and  (b)  Perceptual 
and  Cognitive  Dimensions  of  Pilot  Behavior.  This 
research  is  accomplished  both  in-house  and  by 
various  contractors. 

Learning  Abilities  Measurement  Program 

The  Learning  Abilities  Measurement  Program 
(LAMP)  is  sponsored  by  AFOSR  Air  Force  Office  of 
Scientific  Research.  The  goals  of  the  program  are 
to  specify  basic  parameters  of  learning  ability,  to 
develop  techniques  for  assessing  knowledge  and 
skill  levels,  and  to  explore  the  feasibility  of  a  model- 
based  system  of  psychological  assessment.  The 
long  term  objective  is  to  improve  personnel  selec¬ 
tion  and  classification  systems 

LAMP  is  divided  into  two  categories.  The  first 


category,  Cognitive  Abilities  Measurement,  is  con¬ 
cerned  with  validating  fundamental  learning  abilities 
by  determining  how  learners  differ  in  their  abilities 
to  think,  remember,  solve  problems,  and  acquire 
knowledge  and  skills.  From  research  already  com¬ 
pleted,  LAMP  scientists  have  established  a 
framework  that  assumes  that  observed  learner  dif¬ 


ferences  are  due  to  differences  in  processing  speed ; 
processing  capacity;  the  breadth,  extent,  and  ac¬ 
cessibility  of  conceptual  knowledge;  and  proce¬ 
dural  and  strategic  skills. 

The  second  category  of  research  activities,  Com¬ 
plex  Learning  Assessment,  is  concerned  with  new 
models  of  learning  abilities.  LAMP  researchers  have 
developed  a  number  of  computerized  intelligent 
tutoring  systems  that  serve  as  mini-courses  in  tech¬ 
nical  areas  such  as  computer  programming  and 
electronics  troubleshooting.  A  major  goal  of  this 
part  of  the  program  is  to  develop  principles  for 
producing  indicators  of  student  learning  progress 
and  achievement.  These  indicators  will  serve  as  the 
learning  outcome  measures  against  which  newly 
developed  learning  abilities  tests  will  be  evaluated 

In  the  past  year,  LAMP  researchers  have  con¬ 
ducted  a  series  of  large-scale  studies  that  have 
resulted  in  the  development  of  new  ability  measures 
that  are  now  incorporated  in 
three  experimental  aptitude 
test  batteries.  LAMP  scien¬ 
tists  have  also  found  that 
some  of  these  new 
measures  add  to  our  ability 
to  predict  success  in  learn¬ 
ing  technical  skills  such  as 
computer  programming  and 
troubleshooting.  During  FY 
90  and  FY  91 ,  further  studies 
will  be  conducted  to  deter¬ 
mine  whether  the  new  LAMP 
measures  can  predict  suc¬ 
cess  in  other  learning  situa¬ 
tions  and  in  operational 
technical  training  courses. 

Direct  payoff  for  LAMP  re¬ 
search  should  come  in  the 
form  of  improved  aptitude 
tests  for  enlisted  and  officer 
personnel.  There  may  also 
be  other  benefits,  such  as  improved  systems  for 
testing  a  trainee’s  understanding  as  the  trainee 
progresses  through  a  curriculum.  A  performance 
battery  designed  to  assess  the  information  process¬ 
ing  abilities  of  the  operator  working  in  a  hazardous 
or  unusual  environment  is  another  possible  out¬ 
come. 


Air  Force  Recruits  take  the  learning  abilities  measurement  test. 
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Contact:  Dr.  Joseph  E.  Weeks 
AFHRL/MOE 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)536-3570 
AUTOVON:  240-3570 


Perceptual  and  Cognitive  Dimensions  of 
Pilot  Behavior 


The  pilot  behavior  research  program  deals  with 
issues  related  to  the  cognitive  and  perceptual 
aspects  of  human  visual  information  processing. 
Two  efforts  are  currently  underway:  (a)  visual  atten¬ 
tion,  and  (b)  form  processing  across  the  retina. 

The  visual  attention  research  is  concerned  with 
what  aspects  of  the  visual  world  will  be  selected  for 
attention.  One  line  of  research  deals  with  covert 
visual  attention  shifts  (i.e.,  attention  shifts  without 
eye  movement).  The  goals  of  this  effort  are:  to 
measure  the  time  course  of  attention  shifts,  to  deter¬ 
mine  what  kinds  of  visual  information  are  en¬ 
hanced  by  covert  attention,  to  assess  the  effects  of 
practice  on  attention-shifting  speed  and  information 
processing,  and  to  develop  a  model  of  covert  atten¬ 
tion  effects.  Another  line  of  visual  attention  research 
deals  with  how  intelligence  and  strategy  determine 
each  eye  movement  when  the  task  is  goal-driven. 


Basic  research  at  AFHRL  focuses  on 
fundamental  cognitive  and  perceptual  issues. 
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The  goal  is  to  understand  how 
visual  systems  function  peripherally. 

The  objective  is  to  develop  a  computational  model 
of  the  decision  processes  required  for  each  eye 
movement.  This  research  employs  artificial  intel¬ 
ligence  techniques  to  derive  rules  for  predicting 
patterns  of  eye  movements  during  simplified  flight 
instrument  cross-check  tasks. 

The  second  major  effort  in  the  pilot  behavior  basic 
research  program  addresses  the  manner  in  which 
visual  information  is  processed  across  the  retina 
(including  the  visual  periphery).  Important  research 
questions  are:  What  aspects  of  a  visual  stimulus 
convey  form  information,  and  how  will  the  underly¬ 
ing  mechanisms  operate,  change,  and  interact  at 
various  retinal  eccentricities?  This  research  will  be 
accomplished  by  using  psychophysical  techniques 
to  study  the  perception  of  specified  images  which 
are  created  and  manipulated  by  elementary  function 
techniques  (e.g.,  Fourier  descriptors  and  two- 
dimensional  Gabor  functions).  The  long-range  goal 
is  to  provide  understanding  of  visual  systems  func¬ 
tions  in  the  periphery.  This  information  will  be  used 
to  design  displays  that  are  optimally  matched  to 
human  information  processing  abilities. 

Contact:  Dr.  Elizabeth  Martin 
AFHRUOTU 

Williams  AFB  A2  85240-6957 
Commercial :  (602)  988-6561 
AUTOVON:  474-6561 


V.  TECHNOLOGY  PROGRAMS  (6.2 
AND  6.3) 

Manpower  and  Force  Management 
General  Objective 


This  R&D  develops  better  ways  of  selecting  people 
and  assigning  them  to  Air  Force  specialties  (AFSs); 
determines  job  and  training  requirements  for 
specialties;  and  estimates  the  impacts  of  policy 
changes  on  the  manpower  ard  personnel  process. 
The  results  will  provide  the  basis  for  a  variety  of 
manpower  policy  decisions.  Better  methods  are 
being  developed  for:  (a)  procurement  and  selection 
of  quality  personnel;  (b)  assignment  of  individuals 
to  jobs  compatible  with  their  aptitudes,  interests, 
and  experience;  (c)  establishment  of  effective  reen¬ 
listment  and  career  development  programs;  and  (d) 
design  of  improved  decision  aids  for  Manpower, 
Personnel,  and  Training  (MPT)  needs  relative  to 
weapon  systems. 

Specific  Goals  and  Technical  Approaches 

1.  Personnel  Assessment  Systems.  R&D  is  re¬ 
quired  to  develop  the  best  possible  Air  Force  selec¬ 
tion  and  classification  system.  The  focus  is  not  on 
maintaining  or  replicating  existing  systems  but 
rather,  on  developing  new  measures  or  systems  that 
can  capitalize  on  recent  developments  in  cognitive, 
psychometric,  and  leadership  theories. 


Selection  and  classification  continue 
to  be  a  major  focus  of  AFHRL  R&D. 


During  FY  90-96,  development  of  prototypes  for 
officer  and  aircrew  selection/classification/assess¬ 
ment  systems  will  continue,  along  with  development 
of  prototype  enlisted  assessment  devices  which  are 
specific  to  the  Air  Force. 

Contacts:  Dr.  Lonnie  Valentine,  Jr. 

(Enlisted  and  Officer  Selection  and  Classification) 

AFHRUMOA 

Brooks  AFB  TX  78235-5601 

Commercial:  (512)536-3256 

AUTOVON:  240-3256 

Dr.  Joseph  E.  Weeks 

(LAMP,  Pilot  Selection  and  Classification  System) 

AFHRL/MOE 

Brooks  AFB  TX  78235-5601 

Commercial:  (512)  536-3570 

AUTOVON:  240-3570 

Figure  1  outlines  the  plans  in  this  area.  Major  areas 
within  the  Personnel  Assessment  Systems  Sub¬ 
thrust  are: 

a.  Development  of  New  Measures  of  Air  Force 
Member  Effectiveness  and  Retention  Measures. 
New  measures  of  attributes  thought  to  contribute  to 
effectiveness  and  retention  of  Air  Force  members 
are  being  developed.  Although  the  primary  focus  is 
on  enlisted  personnel,  some  measures  pertain  to 
officers  as  well,  especially  in  the  leader¬ 
ship/management,  commitment/values,  and  adap¬ 
tability  domains. 

Future  efforts  will  develop  and  refine  the  Leader¬ 
ship  Effectiveness  Assessment  Profile  (LEAP),  a 
biographic  survey  designed  to  measure  (1 )  potential 
for  leadership  and  management;  (2)  the  propensity 
to  make  a  commitment  to  the  Air  Force  as  an 
organization;  and  (3)  the  ability  to  function  well  in 
team  situations.  Enlisted  and  officer  prototypes  will 
be  developed,  field-tested,  and  refined.  Four  se¬ 
quential  administrations  will  then  be  made  to  sample 
groups  at  Air  Force  bases.  After  field-testing,  en¬ 
listed  and  officer  versions  of  the  LEAP  suitable  for 
operational  use  will  be  developed  and  validated. 
Performance,  construct  validity,  and  retention 
criteria  for  a  large  worldwide  sample  of  Air  Force 
members  will  be  used  in  this  validation  process.  As 
an  additional  measure  of  Air  Force  values,  an  Air 
Force  Institutional  Values  Survey  will  be  con¬ 
structed.  This  will  be  administered  longitudinally  to 
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PERSONNEL  ASSESSMENT  SYSTEMS 


®  -9 


Air  Force  job  incumbents  assigned  to  a  wide  variety 
of  geographic  locations  and  jobs. 

Aptitude  and  adaptability  requirements  will  be 
identified  for  selected  occupational  specialities.  Ap¬ 
titudes  required  for  successful  performance  by  Air 
Force  enlisted  personnel  in  training  school  and  on- 
the-job  will  be  identified.  Aptitudes  in  the  areas  of 
computer  abilities  and  administrative/clerical 
abilities  will  be  examined,  and  measures  of  those 
aptitudes  will  be  developed.  The  new  measures  will 
then  be  evaluated  in  terms  of  their  reliability,  validity, 
and  utility  for  making  selection  and  classification 
decisions.  The  Adaptability  Screening  Profile  and 
the  Assessment  of  Background  Life  Experiences  will 
be  examined  for  their  utility  in  selecting  those  in¬ 
dividuals  who  will  mostlikely  succeed  in  training  and 
on-the-job.  These  individuals  will  presumably  have 
a  higher  probability  of  being  retained  than  in¬ 
dividuals  who  have  a  lower  probability  of  success, 
but  this  retention  advantage  will  be  determined  em¬ 
pirically. 


Productive  capacity  will  be  examined. 

b.  Productivity  In  Job  Performance.  The  technol¬ 
ogy  of  measuring  job  performance  in  an  effective 
and  cost-efficient  manner  will  be  enhanced.  Various 
factors  that  might  influence  productivity  will  be  ex¬ 


amined  including  training,  experience,  motivation, 
aptitude,  climate,  geographical  location,  and  other 
individual  or  group  characteristics.  Research  on 
productivity  will  be  used  to  construct  equally 
productive  force  structure  alternatives  for  force 
structure  planning  and  policy  development.  Op¬ 
timal  course  lengths  or  other  technical  training 
resource  investments  will  be  analyzed  for  their  im¬ 
pact  on  productivity.  One  promising  measure  of 
productivity,  called  "productive  capacity"  (es¬ 
timated  using  supervisor  ratings),  is  defined  as  "an 
individual's  ability  to  be  productive  on  the  job  in 
comparison  with  top  performance  by  experienced 
personnel".  Productive  capacity  will  be  examined 
for  its  utility  and  linked  to  selection  and  classification 
standards.  This  linkage  will  enable  policy  makers  to 
set  selection  and  classification  standards  based  on 
the  job  performance  (productivity)  required  to  meet 
the  needs  of  the  Air  Force. 

c.  Assessment  Delivery  Modes.  The  measure¬ 
ment  of  aptitudes  and  abilities  via  computer  can  be 
an  important  enhancement  to  the 
personnel  testing  program.  Al¬ 
though  an  initial  expenditure  for 
hardware  is  required,  benefits  of 
using  a  computer-based  mode  for 
assessment  include  :  (1)  immedi¬ 
ate  scoring,  data  analysis,  and 
feedback;  (2)  immediate  checks 
for  honesty  of  responding;  (3) 
decreased  administrative 
processing;  (4)  elaborate  branch¬ 
ing  and  targeting  to  the  capacity 
of  the  respondent;  (5)  reduced 
need  for  scanning  or  hand-scor¬ 
ing  answer  sheets;  and  (6)  im¬ 
proved  assessment  capabilities. 
Computer-based  administration 
opens  the  door  to  the  assessment 
of  abilities  not  measurable  in  a 
paper-and-pencil  mode  (e.g., 
cognitive  processing  speed). 

Before  measures  can  be  ad¬ 
ministered  on  a  computer,  R&D 
must  be  conducted  to  evaluate 
whether  computer-based  assess¬ 
ment  is  accurate,  reliable,  and 
valid  for  predicting  training  and  on-the-job  perfor¬ 
mance,  as  well  as  comparable  to  a  paper-and-pencil 
mode  of  administration.  Because  not  all  facilities 
have  computers,  measurements  must  not  be  af- 
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fected  by  the  method  of  assessment.  Factors  that 
will  be  examined  include:  (1)  the  display  of  items 
and  instructions  (for  example,  the  way  in  which 
illustrations  should  be  displayed,  and  the  number  of 
questions  that  should  be  displayed  on  a  screen  at 
one  time);  (2)  optimal  testing  conditions  in  terms  of 
eyestrain  and  physical  comfort;  (3)  the  time  needed 
to  read  information  on  computer  versus  paper 
(exact  time  limits  for  computer  administration  will 
be  determined);  (4)  equivalence  of  test  scores 
(those  conditions  that  make  computer  and  paper- 
and-pencil  modes  of  assessment  comparable);  (5) 
ways  of  minimizing  the  impact  on  individuals  who 
may  attain  lower  measurements  due  to  unfamiliarity 
with  computers;  and  (6)  new  measures,  such  as  the 
time  spent  on  items  that  are  presented  in  three 
dimensions. 


The  Porta-BAT  is  widely  used 
in  pilot  selection  R&D. 


d.  Officer  Ability  Requirements.  This  R&D  will 
identify  the  aptitudes  required  for  the  successful 
performance  of  Air  Force  officer  tasks.  It  will  result 
in  profiles  of  basic  abilities  that  are  required  within 
specific  Air  Force  officer  specialties.  The  identifica¬ 
tion  of  ability  requirements  will  enable  the  develop¬ 
ment  of  selection  tests  that  measure  abilities  of 
interest.  Payoff  is  expected  in  the  form  of  more 
accurate  selection  decisions,  due  to  increased 
validity  of  job-related  selection  tests.  Selection  tests 
based  on  demonstrated  job  requirements  are  also 
more  defensible  against  charges  of  unfairness. 

Officer  ability  requirements  will  be  determined  at 
the  task  level  for  tasks  identified  as  typical  and 
important,  based  on  available  task  survey  data  from 
the  Air  Force  Occupational  Measurement  Center 
(USAFOMC).  Subject-matter  experts  from  a  par¬ 
ticular  AFS  will  use  ability  rating  scales  to  identify 
ability  requirements  specific  to  their  AFS.  This  will 
result  in  ability  profiles  for  new  or  revised  AFSs,  once 
a  general  pool  of  information  is  collected. 

e.  College  Grade  Point  Averages  (GPAs).  College 
grade  point  average  is  routinely  used  in  selecting 
candidates  for  Officer  Training  School  (OTS).  A 
study  in  FY  90  will  identify  ways  in  which  differences 
in  colleges  can  be  measured.  It  will  also  estimate 
the  degree  to  which  these  differences  may  influence 
the  ability  to  predict  performance  in  OTS  from  GPA. 

f.  Pilot  Selection  and  Classification  System 
(PSACS).  AFHRL  is  developing  an  experimental 
computer  testing  system  to  enhance  the  ability  of 
Air  Training  Command  (ATC)  to  select  and  classify 
pilot  trainees  to  meet  the  needs  of  Specialized  Un¬ 
dergraduate  Pilot  Training  (SUPT).  When  SUPT 
becomes  operational  in  1992,  computerized  test¬ 
ing,  along  with  existing  accession  procedures,  will 
be  used  to  reduce  attrition  and  allow  classification 
into  separate  flying  training  tracks  (bombers/ 
fighters  versus  tankers/transports).  Computer  test¬ 
ing  of  OTS  and  Reserve  Officers  Training  Corps 
(ROTC)  pilot  trainees  undergoing  undergraduate 
Pilot  T raining  (UPT)  at  each  of  five  ATC  pilot  training 
bases  will  be  conducted.  T raining  performance  out¬ 
comes  for  use  in  test  validation  will  be  collected  after 
UPT  and  after  initial  training  on  the  pilot’s  first  opera¬ 
tional  aircraft.  Final  design  specifications  for  the 
experimental  testing  system  will  be  delivered  to 
HSD/YA  in  early  1991.  The  research  methods  will 
then  be  integrated  into  a  full-scale  development 
program  which  will  produce  a  new-generation 
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operational  computer  testing  device  referred  to  as 
the  Basic  Attributes  Test  (BAT).  During  implemen¬ 
tation,  the  BAT  will  be  located  at  ROTC  detachments 
and  Military  Entrance  Processing  Stations,  where 
pilot  applicants  will  be  tested.  Plans  are  for  the  BAT 
to  become  an  operational  part  of  the  pilot  selection 
and  classification  process  in  support  of  SUPT. 
AFHRL  research  in  FY  92-95  will  refine  and  improve 
selection  and  classification  methodology  using  the 
BAT.  The  procedures  will  also  be  extended  to  other 
aircrew  positions.  The  acquisition  of  cockpit  skills 
will  be  tracked  to  determine  how  students’  abilities 
affect  learning  progress  in  different  phases  of  train¬ 
ing.  This  R&D  will  increase  our  understanding  of 
how  measures  of  basic  attributes  can  be  used  in 
aircrew  selection  and  classification  decisions. 

g.  LAMP  Enhanced  Selection  Test  Methods. 
Several  years  will  be  required  to  design  and  evaluate 
new  learning  skill  tests  based  upon  LAMP  basic 
research  program  results.  The  tests  must  be 
validated  over  time.  Examples  of  learning  skill  tests 
that  might  be  developed  are  tests  of  working 
memory  capacity  and  information  processing 
speed. 

2.  MPT  Requirements.  Operational  needs  em¬ 
phasize  the  technical  challenge  and  urgency  of  in¬ 
tegrating  the  various  individual  Manpower, 
Personnel,  and  Training  (MPT)  technologies.  The 
MPT  requirements  subthrust  (initiated  in  FY  86)  will 
develop  and  evaluate  the  technologies,  models,  and 
data  bases  needed  to  support  the  use  of  MPT  re¬ 
quirements  information  when  weapon  system 
design  tradeoff  decisions  are  made.  The  subthrust 
will  also  develop  and  evaluate  various  approaches 
to  personnel  and  training  pipeline  and  retraining 
systems  for  fielding  new  weapon  systems,  and  will 
integrate  MPT  decision  processes  into  existing  sys¬ 
tems.  Prototype  training  systems  for  teaching  prob¬ 
lem-solving  skills  to  airmen  in  high-technology 
specialties  will  be  developed  and  evaluated.  Be¬ 
cause  training  and  personnel  management  respon- 
sibilities  are  presently  divided  among  several  Offices 
of  Primary  Responsibility  (OPRs),  competing  goals 
are  often  inevitable,  and  short-term  fixes  within 
limited  areas  can  suboptimize  total  system  effective¬ 
ness.  The  primary  goal  is  to  provide  a  unified  ap¬ 
proach  to  defining  job  specifications  and  training 
requirements.  These  are  seen  as  the  essential  foun¬ 
dation  for  all  major  personnel  management  func¬ 
tions.  Success  in  the  integration  of  MPT  decision 


processes  is  expected  on  the  basis  of  past  succes¬ 
ses  in  component  R&D  areas. 

Contacts:  Major  Timothy  Bergquist 
(Occupational  Analysis  and  Databases  and 
Projecting  MPT  Requirements  for  New  Weapon 
Systems) 

AFHRL/MOD 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-3648 
AUTOVON:  240-3648 

Lt  Col  Dave  Brown 

(Decision  Aids  and  Force  Models  and  Basic  Job 
Skills  Methodologies) 

AFHRL/MOM 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-3942 
AUTOVON:  240-3942 

Figure  2  outlines  the  plans  in  this  area.  Major  areas 
within  the  MPT  requirements  subthrust  are: 

a.  New  MPT  Technologies.  The  central  effort  in 
the  MPT  requirements  subthrust  is  the  work  on  new 
MPT  technologies.  Examples  of  new  technologies 
being  addressed  are:  the  evaluation  of  more  flexible 
and  effective  Air  Force  Specialty  Code  (AFSC)  struc¬ 
tures  (FY  90);  and  exploratory  research  on  using 
artificial  intelligence  methods  to  help  project  the 
MPT  requirements  of  new  weapon  systems  (FY  91 ). 

b.  Projecting  MPT  Requirements.  The  exploratory 
work  described  above  will  lead  to  an  advanced 
development  program  concerned  with  projecting 
MPT  requirements.  Key  products  will  be:  develop¬ 
ment  of  an  aptitude  requirement  estimator  (FY  91); 
advanced  software  for  the  interface  between  Logis¬ 
tics  Systems  Analysis  (LSA)  and  Instructional  Sys¬ 
tems  Development  (ISD)  (FY  92);  procedures  for 
simulating  Air  Force  specialty  (AFS)  structures  for 
specific  situations  (FY  92);  a  personnel  availability 
forecaster  (FY  93);  a  model  for  estimating  trans¬ 
ferability  of  skills  (FY  94);  and  a  Total  Force  Impact 
Model  (TFIM)  to  aid  MPT  planners  in  balancing  the 
MPT  constraints  for  new  weapon  systems  against 
available  Air  Force-wide  resources  (FY  94). 

c.  New  Methods  for  Analyzing  Occupational  Data. 
Important  inputs  for  the  work  on  projecting  MPT 
requirements  will  be  provided  by  new  methods  for 
analyzing  occupational  data  (FY  90-93).  The  needs 
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Fig  2.  Manpower  and  Force  Management  Subthrust  MO-2.  MPT  Requirements 
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of  the  Air  Force  Occupational  Measurement  Center 
(USAFOMC),  the  Air  Force  Military  Personnel  Cen¬ 
ter  (AFMPC),  and  the  Air  Staff  for  occupational  data 
base  management  will  be  investigated,  particularly 
as  they  relate  to  MPT  integration.  Those  needs  that 
cannot  be  met  by  the  existing  Occupational  Re¬ 
search  Data  Bank  (ORDB)  will  be  considered  for 
inclusion  during  future  developments.  The  use  of 
artificial  intelligence  (expert  systems)  in  analyzing 
occupational  data  will  be  explored.  The  develop¬ 
ment  of  automated  test  outlines  for  use  in  the 
Weighted  Airman  Promotion  System  (WAPS)  test 
development  process  will  provide  significantly  bet¬ 
ter  job  relatedness  and  knowledge-based  tests  (FY 
90).  Currently,  occupational  data  are  collected  and 
analyzed  by  Air  Force  specialty.  New  efforts  are 
under  way  to  do  this  by  weapon  system,  providing 
additional  information  to  Air  Force  decision  makers 
(FY  90-92). 


d.  MPT  Inputs  from  CODAP  and  ORDB.  En¬ 
hanced  capabilities  will  be  developed  for  profile 
analysis,  multidimensional  scaling,  regression 
analysis,  and  factor  analysis.  Work  on  expert  sys¬ 
tems  of  job  analysis  will  be  conducted,  including 
search  and  heuristic  techniques,  pattern  recogni¬ 
tion,  semantic  information  processing,  and  graphi¬ 
cal  methods  of  data  analysis  and  presentation.  With 
the  aid  of  these  new  methods,  it  will  be  possible  to 
develop  advanced  MPT  inputs  using  Comprehen¬ 
sive  Occupational  Data  Analysis  Programs 
(CODAP)  and  the  ORDB  (FY  90-94).  Because  oc¬ 
cupational  data  are  currently  collected  and 
analyzed  by  Air  Force  specialty,  several  new  efforts 
are  designed  to  make  the  CODAP  and  ORDB  data 
available  in  a  weapon  system  format,  rather  than  a 
specialty  format  (FY  90-92). 


MPT  ANALYSIS  SYSTEM 
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e.  Integrated  MPT  Analysis  System.  An  advanced 
development  (6.3)  project  has  been  established  to 
pull  together  the  inputs  provided  by  a  variety  of 
different  efforts  in  the  MPT  requirements  subthrust 
and  will  result  in  the  additional  work  needed  to  make 
these  products  useful  for  Air  Force  purposes.  Exist¬ 
ing  data  bases  will  be  expanded  and  consolidated. 
Models  will  be  tested  in  new  applications,  and  ad¬ 
vanced  versions  of  analytical  models  will  be  or¬ 
ganized  into  decision  support  systems.  These 
decision  support  systems  will  eventually  be  used  by 
MPT  planners  in  the  product  divisions  of  AFSC 
and/or  the  aggregate  systems  planning  shops  of  the 
Air  Staff.  Most  of  the  studies  will  focus  on  the  utility 
of  new  tools  and  data  bases  for  MPT  forecasting 
decisions.  Milestones  are:  consolidation  and 
linkage  of  existing  AFHRL  tools  and  data  bases  (FY 
90);  consolidation  and  linkage  of  selected  non- 
AFHRL  tools  and  data  bases  (FY  91 );  development 
of  support  systems  for  use  in  MPT  planning 
decisions  during  weapon  system  development  (FY 
93);  and  development  and  integration  of  weapon 
system  optimization  models  (FY  96). 


f.  Decision  Aids  and  Force  Models.  Decision  sys¬ 
tems  and  models  are  important  parts  of  the  MPT 
requirements  subthrust.  They  provide  managers  at 
all  levels  with  tools  to  make  important  decisions 
about  competing  MPT  resources.  Examples  of 
models  to  be  developed  are:  a  retraining  person- 
job-match  (PJM)  model  for  both  volunteer  and  non¬ 
volunteer  retrainees  (FY  91);  a  PJM  model  for  career 
enlistment  assignments  (FY  93);  a  prototype  officer 
accession/assignment  model  (FY  93);  a  prototype 
civilian  availability  model  (FY  90);  several  models 
tor  determining  manpower  requirements  to  support 
and  maintain  emerging  weapon  systems  (FY  93-97)  ; 
a  joint  accession/retention  enlisted  labor  market 
model  (FY  91);  a  demographic  trend/impact  es¬ 
timation  model  (FY  93);  an  extended  productivity 
measurement  and  enhancement  model  linking 
laboratory  productivity  research  with  DOD-directed 
total  quality  management  objectives  (FY  93);  and  a 
civilian  labor  market  model  (FY  95). 


APPROACH 


•  THEORIES  OF  EXPERT  PROBLEM  SOLVING 


•  PROCEDURES  BASED  ON  ADVANCES  IN 
ARTIFICIAL  INTELLIGENCE  TO  SPECIFY 
HOW  EXPERTS  SOLVE  PROBLEMS 


COGNITIVE  TASK  ANALYSIS 
TECHNOLOGY 


•  PROCEDURES  BASED  ON  PRINCIPLES  OF 

APPRENTICESHIP  TRAINING  TO  TURN  EXPER  ^  TRAINING  DEVELOPMENT 
KNOWLEDGE  INTO  LEARN  ABLE  CONTENT  TECHNOLOGY 

FOR  TRAINING 


15 


g.  Basic  Job  Skills  (BJS)  Methodologies.  This 
R&D  will  assess  and  measure  the  basic  job  skills  that 
first-term  airmen  need  to  gain  proficiency  in  high- 
technology  (high-tech)  Air  Force  specialties.  "Basic 
Job  Skills"  are  defined  as "  the  core  knowledge  and 
thinking  processes  that  underlie  apprenticeship 
competence  across  the  most  technically  demand¬ 
ing  jobs  in  the  Air  Force."  The  exploratory  develop¬ 


ment  work  in  the  BJS  effort  is  concerned  with  three 
things:  using  recently  developed  cognitive  task 
analysis  techniques  to  determine  the  problem-solv¬ 
ing  skills  and  knowledge  needed  by  airmen; 
developing  diagnostic  achievement  tests  to  deter¬ 
mine  what  an  airman  knows,  and  then  prescribing  a 
training  regime;  and  designing  specifications  for 
training  in  high-tech  specialties  (FY  90-91). 


R&D  APPROACH 


R&D 

RESULTS 


NEXT 
V  PHASE 
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Logistics  technology  R&D  will  develop  methods  to 
design  more  supportable  (reliable,  maintainable, 
operable,  and  affordable)  weapon  systems;  will 
develop  specifications  for  a  fully  integrated  main¬ 
tenance  job  aiding  and  fault  diagnostics  system; 
and  will  provide  more  effective  ways  of  performing 
combat  maintenance.  These  programs  provide  key 
technology  necessary  to  achieve  the  DOD  Com¬ 
puter-Aided  Acquisition  and  Logistics  Support 
(CALS)  initiative. 


This  technical  area  focuses  on  using  information 
systems  technology  to  enhance  logistics  processes 
which  include  the  design,  acquisition,  operation  and 
maintenance  of  weapon  systems.  Improved  infor¬ 
mation  systems  should  allow  Air  Force  personnel  to 
access  quickly  the  information  needed  for  immedi¬ 
ate  decisions  or  tasks.  Integration  of  information 
systems  requires  better  methods  for  identifying  re¬ 
quirements  of  Government  and  industrial  users;  for 
interfacing  computers  for  exchanging  information 
among  data  bases;  for  authoring,  storing,  updating 
and  presenting  data;  for  developing  decision  sup¬ 
port  systems  to  help  use  these  data;  and  for  model¬ 
ing,  analyzing,  and  displaying  information. 
Research  underway  covers  a  broad  spectrum;  it 


ranges  from  human  information  processing  to 
the  use  of  artificial  intelligence  and  to  data 
base  organization.  Planned  technology 
developments  will  influence  the  design  and 
acquisition  of  new  weapon  systems.  They 
also  will  provide  technicians  with  computer- 
based  aids  for  maintaining  weapon  systems 
under  austere  deployment  conditions. 

Specific  Goals  and  Technical  Approaches 

1.  Logistics  Systems.  Two  high-level  initia¬ 
tives  are  spurring  work  in  logistics  systems. 
The  Computer-Aided  Acquisition  and  Logis¬ 
tics  Support  (CALS)  program  is  a  multi-Ser- 
vice  program  directed  by  the  Office  of  the 
Secretary  of  Defense.  The  new  Simultaneous 
Engineering  (SE)  program  has  been  com¬ 
bined  with  the  Unified  Life  Cycle  Engineering 
(ULCE)  program  to  form  a  critical  part  of  the 
Air  Force  Systems  Command’s  effort.  The 
CALS  program  and  the  SE  program  have 
complementary  goals.  CALS  seeks  to 
achieve  improved  supportability  and  sus¬ 
tainability.  It  aims  to  integrate  and  automate 
much  of  the  acquisition  support  process  by 
networking  Computer-Aided  Design  (CAD) 
and  Computer-Aided  Manufacturing  (CAM) 
processes.  The  SE  program  aims  to  develop 
and  demonstrate  an  efficient,  systematic  ap¬ 
proach  to  creating  the  design  of  high  quality 
products.  It  also  aims  to  develop  and 
demonstrate  efficient,  systematic  processes 
for  producing  and  supporting  them.  It  is  an 


AFHRL  work  in  logistics  systems  technology  integrated  design  engineering  process  which 

development  supports  both  CALS  and  SE.  engineers  the  product  and  its  manufacturing 

and  support  processes  at  the  same  time.  SE 
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emphasizes  efficiency,  increased  quality  and 
reduced  costs.  AFHRL  work  in  logistics  systems 
technology  development  supports  both  CALS  and 
SE. 

Contact:  Ms.  Wendy  Campbell 
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Figure  3  outlines  the  plans  in  this  area.  Major  areas 
within  the  Logistics  Systems  Technology  subthrust 
are: 

a.  Information  Engineering.  Engineering  and 
manufacturing  processes  generate  and  maintain 
large  volumes  of  technical  data  in  independently 
developed  systems.  They  often  use  different 
operating  systems  and  data  base  management  sys¬ 
tems.  Because  the  systems  do  not  share  data,  it  is 
difficult  to  manage  and  control  critical  information 
throughout  the  product  life  cycle.  This  R&D  will 
analyze  existing  information  system  specification 
and  design  methods  to  identify  the  technologies 
required  to  integrate  the  information  needed  for 
simultaneous  engineering  activities.  Methodology 
development  and  tool  development  will  continue 
through  FY  94. 


b.  Integrated  Design  Support  (IDS)  System.  IDS 
is  an  information  system  R&D  program  whose  goal 
is  to  improve  the  capture,  management,  use,  and 
dissemination  of  weapon  system  technical  data. 
The  IDS  program  is  developing  an  information  ar¬ 
chitecture  and  a  prototype  software  system  that  will 
allow  the  automated  storage,  retrieval,  and  con¬ 
figuration  management  of  engineering  data  from 
design  engineering  through  manufacturing  to  main¬ 
tenance  and  sustaining  engineering.  The  initial 
development  and  demonstration  will  focus  on  the 
composite  structure  design  of  the  Bl-B.  The  DOD 
does  not  now  get  or  keep  sufficient  technical  infor¬ 
mation  for  the  complete  logistics  support 
(remanufacturing,  third-party  parts  suppliers,  re¬ 
placements  for  obsolete  parts,  etc.)  of  most  weapon 
systems.  As  a  result,  DOD  is  dependent  on  primary 
contractor  support  throughout  the  life  of  the  weapon 
system.  The  IDS  program  is  one  part  of  a  larger 
information  technology  demonstration  being  pur¬ 
sued  by  AFHRL/LR  and  the  Manufacturing  Technol¬ 
ogy  Directorate  at  the  Wright  Research  and 
Development  Center  (WRDC/MTI). 

c.  Productivity  Improvements  in  Simulation 
Modeling  (PRISM)  Project.  The  goal  of  this  project 
is  to  improve  logistics  capability  assessment 
models.  AFHRL’s  goal  is  to  replace  the  Air  Force’s 
current  use  of  inefficient  and  rigid  large-scale 

simulation  models  with  a 
modeling  environment 
based  on  an  object- 
oriented  knowledge  base 
and  high-level  modeling 
tools.  The  modeling  en¬ 
vironment  will  be  graphics- 
based  and  will  enable 
logistics  analysts  to  cus¬ 
tomize  their  models  to  their 
own  particular  problem. 

d.  Computer  Model  of  a 
Maintenance  Technician 
(Crew  Chief).  The  Harry  G. 
Armstrong  Aerospace 
Medical  Research  Labor¬ 
atory  (AAMRL)  and  AFHRL 
are  developing  a  computer 
graphics  model  of  Air 
Force  technicians  for  use 
in  evaluating  the  main¬ 
tainability  of  future  weapon 
systems.  This  program  is 
building  anthropometric 


AFHRL  is  identifying  technologies  required  to  integrate  the 
information  needed  for  simultaneous  engineering  activities. 
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LOGISTICS  SYSTEMS 


19 


e.  Reliability,  Availability  and  Main¬ 
tainability  in  Computer-Aided  Design  (RAM- 
CAD).  This  effort  will  develop  analytical 
models,  computer  software,  data  bases,  and 
work  procedures  that  will  enable  main¬ 
tenance  and  logistics  factors  to  be  included 
in  the  computer-aided  design  of  systems  and 
equipment.  Computer-aided  engineering 
techniques  have  helped  reduce  design 
times.  They  also  have  created  opportunities 
for  engineers  to  consider  the  reliability  and 
maintainability  of  systems  during  the  initial 
design  phases.  A  wide  spectrum  of  CAD 
technologies  for  industrial  design  are  being 
developed  in  the  commercial  market.  These 
CAD  technologies  enhance  drafting 
capabilities  and  the  hardware  design 
process.  Due  to  the  fact  that  maintenance 
and  logistics  considerations  are  not  formally 
a  part  of  the  drafting  process,  industry  has 
Crew  Chief  is  building  anthropometric  m°tivation  to  include  these  considera- 

models  of  Air  force  maintenance  technicians.  t'ons  'nt0  the'r  ^AD  systems.  RAMCAD 

provides  the  only  USAF  funding  for  such 
models  of  Air  Force  maintenance  technicians  to  efforts.  RAMCAD  will  develop  and  demonstrate  in- 

perform  better  maintainability  assessments  during  teractive  computer  techniques  to  design  and 

weapon  system  design.  The  model  interfaces  with  evaluate  the  maintenance  and  logistics  charac- 

existing  commercial  computer-aided  design  (CAD)  teristics  of  weapon  systems  within  a  CAD  environ- 

systems  used  by  aerospace  manufacturers.  The  ment.  It  includes  demonstrations  on  ongoing 

goal  of  C rev/  Chief  is  to  give  CAD  designers  the  weapon  system  development  programs.  TwoRAM- 

ability  to  simulate  maintenance  and  other  related  CAD  efforts  focus  on  providing  solutions  to  long- 

human  operator  interactions 
during  weapon  system 
design.  Long-range  plans 
are  to  make  Crew  Chief  fully 
dynamic,  with  task  time  es¬ 
timation  and  task  analysis 
capabilities.  AFHRL  will  in¬ 
crease  the  efficiency  and 
user-friendliness  of  Cr ew 
Chief  by  integrating  the  Crew 
Chief  data  with  CAD  com¬ 
puter  routines.  Doing  so  will 
allow  task  analysis  and  time 
analyses  to  be  performed 
automatically.  The  project 
consists  of  five  major 
phases:  (1)  animation  (FY 

90) ;  {?.)  collision  detec¬ 
tion/avoidance  (FY  90);  (3) 
human  factors  analysis  (FY 

91) ;  (<1)  activity  modeling 

(FY  90-92);  and  (5)  time  es¬ 
timation  (FY  92).  Aircraft  maintenance  will  be  enhanced 

by  development  of  Crew  Chief  model. 
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standing  weapon  system  reliability,  maintainability, 
and  supportability  (RM&S)  problems.  Their  goals 
are  to  provide  designers  with  an  environment  to  use 
automated  supportability  tools.  The  first,  a  near- 
term  effort,  is  developing  a  prototype  RAMCAD  sys¬ 
tem.  It  will  integrate  a  minimum  of  three  different 
RM&S  software  models  within  a  CAD  system.  Doing 
so  puts  tools  in  the  hands  of  electronic,  mechanical 
and  structural  designers.  The  second  effort  is  long- 
range  R&D  to  aid  electronic  system  designers.  It  will 
aid  them  in  optimizing  their  designs  by  using  the 
proper  analyses,  rules,  and  constraints  at  each 
phase  of  design.  Initial  contract  work  will  be  com¬ 
pleted  in  FY  90,  with  follow-on  test-bed  and  worksta¬ 
tion  development  continuing  through  FY  92. 


complished  in  future  wars.  Aircraft  will  have  more 
complex  systems  and  will  operate  from  small,  dis¬ 
persed  locations.  They  will  depend  less  on  bulky 
test  equipment  and  large  on-site  facilities.  There 
probably  will  be  fewer  technicians.  Each  will  have  to 
master  a  broader  range  of  tasks  and  skills.  Also,  the 
Air  Force's  conventional  technical  orders  (TOs)  are 
often  incomplete,  poorly  organized,  and  difficult  to 
use.  To  address  these  problems,  AFHRL/LRC  is 
developing  a  comprehensive  information  and  job 
aiding  system  to  help  maintenance  technicians  sup¬ 
port  the  sorties  needed  in  future  combat  environ¬ 
ments.  Since  1976,  AFHRL  has  developed  and 
tested  technology  for  electronic  technical  data 
presentation  systems,  techniques,  and  procedures. 


AFHRL  has  developed  and  tested  technology  for  electronic 
technical  data  presentation  systems,  techniques,  and  procedures. 


f.  Decision  Support  Systems 
(DSSs).  This  work  is  composed 
of  several  efforts  to  develop 
decision  support  system  tech¬ 
nologies.  The  DSS  technologies 
will  aid  Air  Force  design  teams  in 
considering  system  design  at¬ 
tributes  and  will  allow  them  to 
arbitrate  between  conflicting 
design  goals.  Key  enabling  tech¬ 
nologies  derive  from  formal 
design  methods,  data  base  struc¬ 
tures,  data  base  management 
systems,  tradeoff  analyses,  and 
expert  system  design  tools.  The 
DDS  effort  will  focus  on  their 
prototyping,  test-bed  implemen¬ 
tation,  and  proof-of-concept 
demonstration.  AFHRL  com¬ 
pleted  development  of  decision 
support  architecture/integration 
requirements  in  September  1 987, 
and  provided  them  to  RAMCAD 
contractors.  System  engineering  and  measure¬ 
ment  efforts  began  during  FY  87.  Current  plans  call 
for  a  36-month  program  focused  on  examining  the 
problem  of  multi-criterion  RM&S  analysis  during  the 
design  cycle  (FY  92).  The  Laboratory  also  is  plan¬ 
ning  to  define  a  knowledge-based  architecture  that 
gives  the  designer  a  highly  interactive  analysis 
capability  for  optimizing  design  requirements  at  any 
level  of  system  assembly  (FY  94). 

2.  Integrated  Maintenance  Information  System 
(IMIS).  Changes  in  threats,  support  concepts,  and 
weapon  system  technology  are  altering  radically  the 
ways  aircraft  maintenance  will  have  to  be  ac¬ 


The  Laboratory  has  focused  its  effort  on  making  it 
easier  to  perform  maintenance  in  a  deployed  com¬ 
bat  environment.  The  final  product  of  this  work  will 
be  draft  military  specifications  which  will  describe 
the  functional  requirements  of  an  IMIS  and  outline 
how  to  adapt  it  to  various  weapon  systems  and 
maintenance  concepts.  The  specifications  will 
cover  technical  orders,  diagnostic  aids,  a  training 
subsystem,  and  a  management  information  subsys¬ 
tem.  They  will  include  information  format,  content, 
and  display  requirements.  The  specifications  will 
define  the  human  factors  and  human-machine  inter¬ 
face  requirements  for  the  system.  These  specifica¬ 
tions  and  standards  will  reflect  data  developed  both 
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through  in-housework  and  through  field  tests  using 
operational  weapon  systems.  IMIS  will  interface 
with  and  support  other  existing  and  planned  base- 
level  maintenance  information  systems.  It  will  link 
existing  and  developing  flightline  systems  with  a 
computer-based  technical  information  system.  The 
IMIS  program  is  closely  coordinated  with  the  Air 
Force  Logistics  Command  (AFLC)  Air  Force  Tech¬ 
nical  Order  Management  System  (AFTOMS),  as  well 
as  other  related  DOD  initiatives.  IMIS  also  will  pro¬ 
vide  diagnostic  job  aids  to  help  technicians 
troubleshoot.  It  will  interface  with  on-board  aircraft 
computers.  A  major  application  of  this  technology 
will  be  the  Advanced  Tactical  Fighter  (ATF).  IMIS 
will  have  several  benefits.  It  will  improve  the  use  of 
available  personnel  and  will  enhance  their  technical 
performance.  IMIS  will  reduce  the  support  equip¬ 
ment  and  technical  documentation  needed  for 
deployment  and  will  improve  training.  The  Air  Force 
could  realize  significant  cost  savings  from  reduced 
formal  training.  Perhaps  most  significantly,  IMIS’s 
diagnostic  capabilities  will  allow  technicians  to 
troubleshoot  faults  more  rapidly  and  accurately.  As 
a  result,  maintenance  personnel  will  be  able  to 
return  aircraft  sooner  to  operational  use  and  will  use 
fewer  spare  parts. 

Contact:  Mr.  Robert  C.  Johnson 
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The  roadmap  for  the  IMIS  subthrust  is  at  Figure  4. 
Major  areas  of  work  are  as  follows: 

a.  IMIS  Functional  Requirements  Definition. 
AFHRL  is  developing  a  formal  requirements  defini¬ 
tion  for  the  tactical  environment.  The  Laboratory  will 
turn  these  formal  requirements  into  prototype 
hardware  and  software,  which  will  be  tested  in  the 
field  in  1993.  The  test  is  expected  to  demonstrate 
the  full  capabilities  of  the  integration  of  all  of  IMIS’s 
technical  and  management  functions. 

b.  IMIS  Diagnostic  Demonstrations  (IMIS-DD). 
This  effort  will  develop  an  integrated  diagnostic  sys¬ 
tem  for  IMIS,  using  the  F-16,  F-18,  and  X-29  aircraft 
as  test  systems.  It  will  result  in  a  first-generation 
system.  The  system  will  have  a  control  structure  for 
calling  up  test  procedures.  It  will  also  have  a 
mechanism  for  flagging  and  enhancing  the  data 
base  where  it  is  insufficient  to  isolate  a  failure.  The 


system  also  will  have  a  capacity  for  explaining  the 
logic  of  tests  to  its  users.  AFHRL  carried  out  a 
successful  field  test  on  the  F-16  fire  control  radar  in 
May  1989.  A  more  complete  field  test  will  use  the 
Navy  F/A-1 8  aircraft  and  take  place  in  late  1990. 

c.  IMIS  Draft  Specifications.  To  achieve  the  in¬ 
tegrated  information  required  to  support  both  CALS 
and  technical  information  systems,  DOD  must  im¬ 
plement  specifications  and  standards  for  the  crea¬ 
tion,  storage,  transmission  and  use  of  digital 
technical  information.  A  major  aim  is  to  develop 
specifications  so  maintenance  technicians  can  use 
the  systems  effectively.  This  effort  includes  the 
development,  field  demonstration,  and  evaluation  of 
content,  format,  user  interface,  and  data  base  struc¬ 
ture.  It  will  cover  the  functional  requirements  for 
hardware  and  integrating  software. 

d.  Authoring  and  Presentation  System  (APS). 
This  effort  has  produced  the  capability  to  author  and 
present  IMIS  technical  data.  APS  uses  a  "neutral" 
data  base,  which  allows  the  data  to  be  presented  on 
a  variety  of  hardware  systems.  (By  contrast,  most 
authoring  systems  permit  the  data  to  be  presented 
on  only  one  hardware  system.)  Several  major  Air 
Force  and  Army  weapon  systems  are  using  the  APS 
to  author  digital  data.  Work  has  recently  begun  to 
rewrite  APS  in  an  object-oriented  language.  Rewrit¬ 
ing  will  ensure  that  APS  can  accommodate  function¬ 
al/physical  modeling  capabilities  and  diagnostic 
data  base  requirements.  A  rewritten  APS  also  could 
support  the  requirements  for  aircraft  battle  damage 
assessment  (ABDA)  and  aircraft  battle  damage 
repair  (ABDR). 

e.  F/A-1 8  Field  Demonstration:  In  the  F/A-1 8  field 
demonstration,  AFHRL  is  working  with  the  Navy  to 
develop  and  test  an  on-aircraft  interactive  diagnos¬ 
tic  capability.  This  work,  scheduled  for  completion 
in  FY  91 ,  will  involve  a  more  extensive  test  of  the 
systems  developed  and  tested  on  the  F-16. 

f.  Full  IMIS  Development  and  Demonstration: 
AFHRL  is  developing  a  complete  IMIS  system, 
which  will  integrate  and  display  all  of  the  main¬ 
tenance  information  important  to  the  flightline  tech- 
nician  in  future  dispersed  maintenance 
environments.  It  will  be  field-tested  during  FY  93. 
This  project  will  analyze  the  total  information  re¬ 
quirements  for  future  maintenance  environments.  It 
will  develop  and  field-test  a  complete  information 
system  to  meet  those  requirements.  This  project 
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Fig  4.  Logistics  Technology  Subthrust  LR-2.  Integrated  Maintenance  Information  System 


will  produce  by  FY93  the  functional  specifications 
for  the  full-scale  development  of  an  IMIS  system. 

3.  Combat  Capability  Assessment.  This  R&D  will 
improve  the  readiness  and  capability  of  main¬ 
tenance  units  to  sustain  high  aircraft  sortie  rates 
under  wartime  conditions.  AFHRL  is  developing 
methods  to  determine  which  tasks  are  essential  to 
combat  and  how  organizations  and  procedures  dif¬ 
fer  in  peacetime  and  combat  conditions.  The 
Laboratory  will  use  the  information  to  improve  com¬ 
bat-oriented  operating  practices  and  training 
programs.  The  effort  will  build  upon  recently  com¬ 
pleted  work  on  AFSC  restructuring  and  aircraft 
maintenance  in  chemical  warfare  environments. 

Contact:  Mr.  Robert  C.  Johnson 

AFHRL/LRC 

Wright-Patterson  AFB  OH  45433-6503 

Commercial:  (513)255-2606 

AUTOVON:  785-2606 

A  roadmap  for  the  work  in  this  subthrust  is  at  Figure 
5.  Major  areas  of  work  are  as  follows: 

a.  Maintenance  Limitations  in  a  Chemical  Warfare 
Environment.  This  R&D  will  develop  a  methodology 
for  identifying  maintenance  capabilities  and  limita¬ 
tions  in  a  chemical  warfare  environment.  Research 
products  will  include  task  performance  times  for  the 
chemical  defense  protective  suit,  recommendations 


for  equipment  and  training  improvements,  and 
work-arounds  for  difficult  problems.  Analyses  to 
determine  whether  technicians  can  learn  to  adapt  to 
tight  locations,  awkward  access  areas,  and  other 
difficult  task  circumstances  are  now  in  process.  The 
analyses  also  are  addressing  how  much  these  ac¬ 
commodations  will  transfer  to  tasks  with  similar 
characteristics.  If  results  are  successful,  a  training 
program  could  specify  which  tasks  to  practice  in 
chemical  protective  gear  so  that  technicians  will  be 
able  to  perform  a  much  larger  set  of  maintenance 
tasks. 

b.  Impacts  of  Stress.  The  objective  of  this  work  is 
to  examine  the  feasibility  of  various  approaches  to 
reducing  the  occurrence  and  potential  impacts  of 
stress  in  aircraft  maintenance  organizations.  In  FY 
89,  AFHRL  rated  and  prioritized  the  approaches 
based  on  factors  such  as  their  cost  effectiveness, 
their  implementation  difficulties  and  their  prob¬ 
abilities  of  success.  The  Laboratory  is  planning  a 
follow-on  field  test  to  further  develop  and  test  the 
approaches. 

c.  Combat  Data  Analysis.  This  effort,  which  is 
scheduled  for  completion  in  FY  91 ,  aims  to  develop 
an  integrated  combat  data  base  using  actual  exer¬ 
cise  data  from  U.S.  and  foreign  sources.  The  data 
base  can  be  used  to  depict  actual  combat  condi¬ 
tions.  It  will  be  used  by  analysts  to  determine  war¬ 
time  requirements  and  sortie  capabilities. 
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COMBAT  CAPABILITY  ASSESSMENT 
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Logistics  Technology  Subthrust  LR-3.  Combat  Capability  Assessment 


AFHRL  R&D  will  develop  a  methodology  for  identifying  maintenance 
capabilities  and  limitations  in  a  chemical  warfare  environment. 


Training  Technology 


General  Objective 

The  goal  of  training  R&D  is  to  increase  combat 
readiness  and  job  performance  by  developing  and 
demonstrating  more  cost-effective  ways  of  acquir¬ 
ing  and  maintaining  new  skills.  AFHRL  develops 
new  training  strategies  and  systems  that  result  in 
increased  combat  readiness  and  higher  quality  job 
performance.  The  improvements  in  combat  readi¬ 
ness  focus  on  reducing  early  loss  rates  and  increas¬ 
ing  survivability,  so  that  more  equipment  and 
personnel  will  be  available  for  subsequent  combat 
efforts.  Improved  cost  effectiveness  would  make  it 
possible  to  train  more  personnel  to  high  levels  of 
performance  and  permit  more  efficient  use  of  limited 
training  resources. 


Specific  Goals  and  Technical  Approaches 

1.  Aircrew  Training  Requirements.  The  drive 
toward  lower-cost  aircrew  training  will  be  advanced 
by  improved  techniques  for  identifying  training  re¬ 
quirements  and  designing  simulators.  The  applica¬ 
tion  of  new  aircrew  training  systems  and  simulation 
techniques  will  permit  savings  by  providing  high 
quality  training  in  cost-effective  ways.  Important 
goals  for  aircrew  training  are  to  identify  the  amount 
of  simulator  fidelity  required  and  to  determine  the 
extent  to  which  specialized  training  system  charac¬ 
teristics  should  be  used  to  help  enhance  training. 
This  information  is  needed  to  help  designers  of  Air 
Force  training  systems  decide,  "How  much  is 
enough  for  a  given  task?" 


AFHRL  developed  specifications  to  better  define 
and  integrate  all  phases  of  flying  training. 
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Contact:  Dr.  Elizabeth  Martin  contribute  to  guidelines  for  designing  training  sys- 

AFHRL/OTU  terns  that  fully  use  the  capabilities  of  a  given  training 

Williams  AFB  AZ  85240-6457  device,  integrate  differing  media  in  cost-  and  train- 

Commercial:  (602)  988-6561  ing-effective  ways,  and  can  be  used  to  design  total 

AUTOVON:  474-6561  training  systems  to  coordinate  all  phases  of  training. 

A  report  describing  lessons  learned  and  findings 
A  roadmap  for  the  plans  in  this  area  is  at  Figure  6.  from  the  C-1 30  ATS  will  be  published  in  FY  91 .  The 

Important  areas  of  work  are  as  follows:  training  guidelines  should  be  useful  in  a  wide  variety 

of  aircrew  training  systems  as  a  total  training  sys- 
a.  Training  System  Design  Guidelines.  Specif ica-  terns  design  manual, 

tions  were  developed  to  better  define  a  spectrum  of 

training  media,  and  integrate  all  phases  of  training.  b.  Visual  Scene  and  Display  Requirements.  Addi- 
Military  Airlift  Command  (MAC)  and  AFHRL  have  tional  efforts  will  be  conducted  in  the  visual  fidelity 

incorporated  these  concepts  into  the  C-1 30  Aircrew  area  during  FY  90-91.  During  FY  90,  work  will  be 

Training  System  (ATS).  The  program  includes  an  completed  on:  criteria  for  tactical  simulator  display 

evaluation  of  the  ATS  and  its  major  elements,  as  well  brightness;  criteria  for  simulator  display  resolution; 

as  an  R&D  component  to  address  cost-effective-  specification  of  skill  requirements  for  various  levels 

ness  issues  in  the  context  of  the  C-1 30  ATS.  Similar  of  target  detail;  and  a  handbook  of  visual  scene 

programs  are  being  developed  for  the  B-52/KC-1 35  requirements  for  training  FY  92  low-level  flight  skills, 

formal  school.  Collectively,  these  programs  will  This  hand  book  will  be  partly  based  upon  the  perfor- 


AFHRL  is  developing  a  handbook  partly  based  upon  the 
performance  of  pilots  in  a  variety  of  visual  scene  conditions. 
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AIRCREW  TRAINING  REQUIREMENTS 
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Fig  6.  Training  Technology  Subthrust  OT-1.  Aircrew  Training  Requirements 


Studies  will  evaluate  the  ability  of  subjects  to 
determine  basic  characteristics  of  ground  targets. 


mance  of  pilots  in  a  variety  of  visual  scene  condi¬ 
tions.  Differing  textures,  2-  and  3-dimensional  ob¬ 
ject  types  and  densities,  sizes  of  objects,  shadings, 
shadows,  and  atmosphere  attenuation  will  be  ex¬ 
plored.  During  FY  90,  a  supplemental  report  will  be 
completed  containing  recommendations  regarding 
the  use  of  color  in  flight  simulation. 


configurations  of  in- 
house  cockpit  simula¬ 
tors  (up  to  14)  by  FY  92. 
The  modular  software 
(developed  in  FY  90  as 
part  of  a  joint-Service 
program)  will  be  a 
standard  IOS  software 
package  applicable  to 
simulation  in  general. 

e.  Cost/Training- 
Effectivness  Methodol¬ 
ogy.  This  issue  is 
primarily  concerned 
with  the  design  and  im¬ 
plementation  of  a  data 
base  that  can  be  used  to 
consolidate  existing  in¬ 
formation  about  cost / 
training-effectiveness 
relationships  and  make 
it  available  when  cost 
tradeoff  decisions  must 
be  made.  Most  of  the  work  in  this  area  is  being 
conducted  by  the  Army  Research  Institute  (ARI)  and 
the  DOD  Training  and  Performance  Data  Center 
(TPDC).  ARI  has  been  developing  a  model  for  the 
Optimization  of  Simulation  Based  Training  Systems 
(OSBATS)  since  FY  86.  AFHRL  is  providing  data  for 


c.  Sensor  Scene  Requirements. 
During  FY  90,  studies  of  infrared 
and  radar  image  fidelity  will  be  con¬ 
ducted.  One  set  of  studies  will 
evaluate  the  ability  of  subjects  to 
determine  basic  characteristics  of 
ground  targets,  such  as  orientation 
and  classification,  as  a  function  of 
sensor  image  fidelity.  Another  set 
of  studies  will  determine  the  amount 
of  simulated  infrared  scene  fidelity 
needed  to  train  low-altitude  terrain¬ 
following  and  navigation  tasks. 

d.  Multi-Cockpit  IOS  Prototype. 
During  FY  90-92,  work  will  be  con¬ 
ducted  on  multi-cockpit  Instructor 
Operator  Station  (IOS)  designs  and 
modular  IOS  software.  The  multi¬ 
cockpit  IOS  will  be  capable  of  inter¬ 
facing  with  subsequent  prototype 


Work  will  be  conducted  on  multi-cockpit 
Instructor  Operator  Station  designs. 


30 


use  in  testing  this  model.  Although  OSBATS  is  not 
yet  complete,  the  model  is  expected  to  provide  a 
comprehensive  way  of  estimating  the  cost/training 
effectiveness  of  aircrew  training  simulators  by  FY  90. 
The  computer  model,  when  fully  refined,  will  provide 
a  way  of  determining  optimum  points  on  the  simula¬ 
tion  cost-versus-fidelity  curve.  TPDC  is  responsible 
for  incorporating  training-effectiveness  data  into 
TPDC  data  bases  when  the  data  are  ready  for  this 
transition. 

f.  Measures  of  Air  Combat  Performance.  The  ob¬ 
jective  is  to  validate  and  refine  techniques  for  as¬ 
sessing  air  combat  performance  using  the  Air 
Combat  Maneuvering  (ACM)  Performance  Meas¬ 
urement  System  (PMS).  The  PMS  was  developed 
for  the  Simulator  for  Air-to-Air  Combat  (SAAC)  and 
the  Air  Combat  Maneuvering  Instrumentation 
(ACMI)  range.  The  R&D  will  identify  and  implement 
alternative  scoring  techniques.  It  will  also  collect 


data  that  reflect  the  relative  validity  of  these  alterna¬ 
tive  scoring  procedures.  Upon  completion  of  the 
F-15  beyond-visual-range  PMS,  this  work  will  be 
transitioned  to  the  F  1 S.  The  end  products  in  FY  91 
will  be  techniques  and  procedures  for  measuring  air 
combat  performance. 

2.  Aircrew  Training  Technology  Development. 
The  mission  of  AFHRL  includes  the  design,  develop¬ 
ment,  and  evaluation  of  new  methods,  equipment, 
and  simulator  devices  for  use  in  aircrew  training. 

Contact:  Mr.  Harold  E.  Geltmacher 

AFHRL70TE 

Williams  AFB  A Z  85240-6457 

Commercial:  (602)  988-6561 

AUTOVON:  474-6561 

Several  efforts  are  planned  in  the  subthrust,  as 
illustrated  by  the  roadmap  shown  in  Figure  7. 


AFHRL  is  validating  and  refining  techniques 
for  assessing  air  combat  performance. 
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AIRCREW  TRAINING  TECHNOLOGY  DEVELOPMENT 


Fig  7.  Training  Technology  Subthrust  OT-2.  Aircrew  Training  Technology  Development 


a.  Part-Task  Training  Methods  and  Decision  Sup¬ 
port  Systems.  The  practice  of  subdividing  complex 
flight  tasks  into  various  parts  is  a  logical  way  of 
presenting  the  student  with  a  task  that  is,  at  the 
outset,  not  too  difficult  to  master.  By  this  rationale, 
the  larger  or  more  difficult  the  task,  the  greater  the 
advantage  of  part-task  training.  The  critical  require¬ 
ment  in  designing  part-task  training  is  to  select 
effective  strategies  for  partitioning  a  task  for  part 
practice,  then  later  to  reintegrate  the  parts  into  the 


whole  task.  AFHRL  R&D  has  focused  upon  task 
partitioning  strategies  (e.g.,  simplification,  frac- 
tionization,  segmentation)  in  designing  the  PTT  sys¬ 
tem;  the  need  for  and  importance  of  performance 
measurement  systems  as  opposed  to  simple  prac¬ 
tice  without  performance  measurement;  and  ways 
in  which  computer-assisted  instruction  techniques 
can  be  used  to  facilitate  the  part-task  training 
process.  During  FY  90,  0T  will  validate  the  various 
methods  of  partitioning  tasks  that  have  already  been 
developed  and  demonstrate  PTT  devices  in  different 
major  command  (MAJCOM)  settings.  A  decision 
support  system  for  use  by  PTT  system  designers  will 
be  developed  in  FY  92,  and  the  information  on  the 
use  of  computer-assisted  instruction  techniques  will 
be  pulled  together  and  integrated  into  a  users  guide 
for  Part-Task  Training  devices  in  FY  93.  Following 


this  (in  FY  94),  some  advanced  work  will  be  con¬ 
ducted  on  the  networking  of  interactive,  low-cost, 
multi-person  aircrew  training  devices. 

b.  Combat  Crew  T raining  School  (CCTS)  Modern¬ 
ization.  A  thorough  review  and  analysis  of  Air  Force 
B-52  and  KC-135  training  requirements  will  be  con¬ 
ducted  in  order  to  prepare  a  detailed  functional 
design  specification  for  the  training  conducted  at 
the  B-52/KC-135  CCTS.  The  modernized  program 
will  provide  for  the  effective  use 
of  existing  training  media  and 
the  optimal  mix  of  academics, 
ground  trainer,  and  flight  in¬ 
struction  required  to  produce 
combat-ready  aircrews.  In¬ 
cluded  within  the  total  training 
system  design  will  be  the  defini¬ 
tion  of  computer  and  main¬ 
tenance  support,  instructional 
delivery,  performance  evalua¬ 
tion,  and  total  training  system 
management. 

c.  New  Simulator  Com¬ 
ponents  and  Software  Systems. 
New  simulator  components  and 
software  systems  to  be  inves¬ 
tigated  are:  (1 )  a  thermal  model 
to  assign  "gray"  shades  to  por¬ 
tions  of  an  infrared  computer¬ 
generated  image  (based  upon 
environmental  conditions)  so 
that  forward-looking  infrared 
(FUR)  sensors  can  be  simulated 
(FY  90);  (2)  a  VME-based 
modular  computer  software  architecture  that  will 
enable  re-hosting  of  current  simulation  software 
systems  using  inexpensive  microprocessors  (FY 

91) ;  (3)  a  helmet-mounted  liquid  crystal  display 
(LCD)  that  will  provide  inexpensive  visual  display 
combat  simulation  applications  (FY  91);  (4)  a  high¬ 
brightness,  high-resolution  wraparound  visual  dis¬ 
play,  the  dodecadome,  which  makes  use  of 
inexpensive  cathode-ray  tube  (CRT)  projectors  (FY 

92) ;  (5)  field-deployable,  microprocessor-based 
image  generators  (FY  94);  (6)  an  eye-tracked  vari¬ 
able  acuity  visual  display  system  that  approaches 
the  resolution  of  the  human  visual  system  (FY  95). 

d.  Long  Distance  Network  Development.  The 
local  area  network  system  will  be  expanded  into  a 
long  distance  network  in  FY  92-93,  as  the  state-of 


AFHRL  R&D  has  focused  upon  task  partitioning 
strategies  in  designing  the  part-task  training  system. 
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the-art  is  expected  to  permit  that  kind  of  advance  at 
that  time.  This  will  permit  pilot  trainees  in  one  part 
of  the  world  (e.g.,  the  Red  Flag  training  staff  at  Nellis 
AFB)  to  engage  in  combat  with  pilots  in  another  part 
of  the  world  (e.g. ,  United  States  Air  Forces  in  Europe 
[USAFE])  without  leaving  their  home  base. 

e.  Advanced  Interface  Studies.  During  FY  94,  a 
number  of  advanced  interface  studies  will  be  con¬ 
ducted  with  the  objective  of  expanding  the  scope  of 
the  Aircrew  Combat  Mission  Enhancement  (ACME) 
training  system  to  include  Navy  and  Army  forces. 
Work  will  also  be  conducted  to  evaluate  the  use  of 
these  expanded  simulation  programs  to  evaluate 
war-gaming  options  and  to  study  the  conditions 
under  which  the  development  of  creative  solutions 
to  combat  problems  is  facilitated  by  the  use  of 
training  simulator  devices. 

3.  Aircrew  Combat  Mission  Enhancement 
(ACME).  ACME  is  an  advanced  development 
project  whose  objective  is  the  enhancement  of  com¬ 
bat  mission  readiness  through  advances  in  flight 
simulation  technology.  The  primary  thrust  of  the 
program  will  be  to  investigate  issues  of  training 
effectiveness  concerning  the  value  of  multi-ship 
combat  simulation.  Two  principal  products  will  be 
developed  and  delivered  under  ACME  to  support 
the  training  effectiveness  research  program:  (1)  a 
situational  awareness  training  research  facility  for 
conducting  multi-ship  force-on-force  combat 
simulation  R&D;  end  (2)  a  mission  rehearsal  training 
research  capability  that  will  permit  determination  of 
terrain/target  familiarization  and  attack  coordina¬ 
tion/timing  requirements.  Both  capabilities  will  be 
used  in  support  of  a  continuing  technology  base 
research  program  attempting  to  provide  answers  to 
the  critical  issues  of:  how  to  measure  and  assess 
the  combat  readiness  of  our  aircrews;  what  can  be 
done  to  facilitate  the  acquisition  and  maintenance 
of  an  enhanced  state  of  readiness;  how  to  structure 
training  to  systematically  address  the  problems  of 
situational  awareness  and  mission  rehearsal;  and 
how  to  match  a  specific  training  requirement  to  the 
most  cost-effective  level  of  device  fidelity.  The  bot¬ 
tom  line  is,  "How  can  we  best  prepare  our  aircrews 
to  meet  the  demands  of  a  wartime  environment 
using  limited  peacetime  resources?" 


Contact:  Dr.  Wayne  L  Waag 

AFHRL/OTE 

Williams  AFB  A Z  85240-6457 

Commercial:  (602)988-6561 

AUTOVON:  474-6561 

A  roadmap  for  the  plans  in  this  area  is  at  Figure  8. 
Important  areas  of  work  are: 

a.  Training  Effectiveness  Evaluations.  A  vigorous 
program  of  behavioral  research  will  address  training 
effectiveness  issues  associated  with  multi-ship 
combat  training  simulation.  Specifically,  experi¬ 
ments  will  be  conducted  to  quantify:  (1)  the  effec¬ 
tiveness  of  training;  (2)  the  military  value  of  such 
training,  by  considering  both  costs  and  measured 
increases  in  operational  effectiveness;  and  (3)  the 
tradeoffs  between  centralized  and  distributed  train¬ 
ing  resources  (i.e.,  training  centers  versus  squadron 
training).  Up  to  five  critical  experiments  will  be 
conducted  for  four  primary  mission  areas:  Air-to- 
air,  interdiction,  close  air  support,  and  mission  re¬ 
hearsal.  In  accomplishing  these  studies,  facilities  to 
be  used  include  the  ACME  multi-ship  test-bed  R&D 
facility,  as  well  as  simulation  facilities  available  within 
industry.  For  the  interdiction  mission,  the  following 
five  experiments  will  be  accomplished  using  the 
in-house  ACME  test-bed:  (1)  utility  evaluation  of  the 
perceived  effectiveness  of  the  simulation  in  FY  91- 
92;  (2)  within-simulator  learning  and  transfer  in  FY 
92-94;  (3)  between-simulator  transfer  effects  using 
low-cost  reconfigurable  pilot  stations  in  FY  91-94; 
(4)  real-world  transfer  of  training  in  FY  94-95;  and  (5) 
unit  effectiveness  evaluations  in  FY  95-99.  Results 
from  these  critical  experiments  will  be  used  to  quan¬ 
tify  the  benefits  gained  from  ground-based  combat 
simulation  training. 

b.  F-15  Advanced  Air  Combat  Simulation.  In  FY 
88,  AFHRL  initiated  an  ACME  proof-of-concept 
demonstration  using  simulation  facilities  available 
within  industry.  In  a  joint  effort  with  the  Tactical  Air 
Command  (TAC),  a  simulation  training  program  was 
created  using  the  engineering  simulation  facility  at 
the  McDonnell  Douglas  Aircraft  Corporation  in  St. 
Louis,  MO.  Training  scenarios  focused  on  the 
various  air-to-air  missions  including  sweep,  combat 
air  patrol,  and  escort.  User  acceptance  data,  as  well 
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Training  Technology  Subthrust  OT-3.  Aircrew  Combat  Mission  Enhancement  (ACME) 


AFHRL  has  enhanced  training  effectiveness 
using  multiple  moving  models. 


as  engagement  outcome  information,  were 
gathered  throughout  the  program.  The  results  indi¬ 
cate  that  both  pilots  and  air  weapons  controllers 
considered  the  training  received  to  be  quite  valu¬ 
able.  The  outcome  data  indicate  improvements  in 
performance  as  a  function  of  such  training.  Begin¬ 
ning  in  FY  90,  this  program  will  transition  to  TAC. 
AFHRL  plans  to  continue  work  in  the  air-to-air  mis¬ 
sion  area  at  the  St.  Louis  facility,  with  the  following 
training  effectiveness  experiments  scheduled:  (1) 
within-simulator  learning  and  transfer  in  FY  90-91 ; 

(2)  between-simulator  transfer  effects  using  low- 
cost  reconfigurable  pilot  stations  in  FY  90-92;  and 

(3)  real-world  transfer  of  training  in  FY  92-93. 


scenario  preparation,  on-line 
monitoring,  and  post-mission 
debriefing;  and  a  modular 
threat  environment  simulation 
system.  These  components 
will  be  networked  together 
using  the  approach 
developed  by  Defense 
Avanced  Research  Projects 
Agenc  (DARPA)  in  the  Army’s 
SIMNET  facility.  The  simula¬ 
tion  complex  will  also  have  the 
capability  for  long-haul  net¬ 
working  to  other  simulation 
facilities.  Candidate  locations 
and  facilities  include  the  VTRS 
facility  at  the  Naval  Training 
Systems  Center  (NTSC)  in  Or¬ 
lando,  the  new  Simulator 
Complexity  Test-Bed  Facility 
being  developed  by  ARI  at  Ft 
Rucker,  and  the  SIMNET  com¬ 
plex  at  Ft  Knox.  Completion 
of  this  situational  awareness 
training  research  complex  is 
expected  by  FY  92.  The  addition  of  a  photo-texture 
image  generation  capability  will  produce  a  system 
capable  of  pre-strike  mission  planning  and  rehears¬ 
al.  It  will  enable  crews  to  practice  waypoint/target 
area  familiarization,  as  well  as  attack  coordination 
and  timing.  Technology  requirements  include  the 
development  of  a  multispectral  image  generation 
capable  of  producing  photographic-quality  visual 
imagery  and  generating  data  bases  rapidly.  Ex¬ 
pected  completion  date  of  the  mission  rehearsal 
capability  is  FY  95.  The  individual  components 
within  this  facility  are  described  in  subsequent  sec¬ 
tions. 


c.  ACME  R&D  Test-Bed  Facility.  The  ACME  R&D 
test-bed  facility  will  produce  an  interactive  force-on- 
force  simulation  of  a  wartime  environment.  To  ac¬ 
complish  this,  a  tactical  multi-ship  simulation 
focusing  on  the  F-16  aircraft  will  be  developed  at 
Williams  AFB.  The  network  will  eventually  consist 
of:  four  F-16  cockpits  with  state-of-the-art  out-of- 
the-cockpit  visual  systems  consisting  of  two  full- 
field-of-view  domes  and  two  fiber  optic 
helmet-mounted  displays;  four  F-16  player  stations 
with  full  functioning  avionics  but  limited  visual 
capabilities;  two  tactical  air  control  stations  for  Red 
and  Blue  forces;  an  instructional  support  system  for 


d.  Fiber  Optic  Helmet-Mounted  Displays.  The  ob¬ 
jective  of  the  Fiber  Optic  Helmet-Mounted  Display 
(FOHMD)  program  is  to  develop  a  cost-effective 
visual  display  suitable  for  both  air-to-air  and  air-to- 
ground  tactical  simulation.  This  objective  is 
achieved  by  using  high-brightness  projectors  to 
supply  imagery  which  is  optically  combined  to  pro¬ 
vide  a  high-resolution  inset  within  a  low-resolution 
background.  This  imagery  is  injected  into 
lightweight,  flexible  fiber  optic  bundles  for  delivery 
to  the  pilot’s  eyes  via  helmet-mounted  infinity  dis¬ 
play  optics.  By  tracking  head  and  eye  position,  the 
insets  can  be  servoed  to  the  point  of  gaze,  thus 
providing  a  resolution  and  viewing  space  nearly 
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The  objective  of  the  FOHMD  is  to  develop  a  cost-effective  visual 
display  for  both  air-to-air  and  air-to-ground  tactical  simulation. 


equal  to  that  required  by  the  human  visual  system.  with  a  fully  functioning  eyetracker  will  be  completed 
This  program  is  a  50/50  cost-sharing  program  with  in  FY  90.  Enhancements  to  the  fiber  bundles  will  be 
the  Canadian  government.  Retrofit  of  the  system  completed  in  FY  91 . 


AFHRL  R&D  has  developed  a  new  low-cost, 
high-resolution,  wide  field-of-view  display. 
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e.  Full-Field-of-View  Dome.  The  goal  of  this  pro¬ 
gram  is  to  develop  a  display  system  capable  of 
providing  imagery  over  the  entire  field  of  view  as 
seen  from  the  cockpit  of  an  F-16  aircraft.  The  sys¬ 
tem  will  provide  high-resolution  imagery  that  per¬ 
mits  both  air-to-air  and  air-to-ground  training.  The 
effort  is  a  joint  AFHRL/OT  and  Aeronautical  Sytems 
Division  (ASD/YW)  program  in  which  funding  is 
shared  equally.  The  24-foot  dome  display  system, 
which  is  being  developed  by  McDonnell  Douglas 
Aircraft,  will  include  a  high-resolution,  40-degree 
linear  inset  displayed  against  a  low-resolution  back¬ 
ground.  The  system  will  be  headtracked,  with  the 
provision  for  adding  eyetracking  as  that  technology 
becomes  available.  Upon  delivery,  the  system  will 
be  interfaced  with  the  Advanced  Visual  Technology 
System  (AVTS)  at  AFHRLand  will  be  used  for  visual 
training  effectiveness  work  as  well  as  being  a 
primary  high-end  component  of  the  ACME  R&D 


The  Full-Field-of-View  Dome  will  provide  a  view 
as  seen  from  the  cockpit  of  an  F-16  aircraft. 


test-bed  facility.  Delivery  and  integration  will  be 
completed  in  FY  90.  Training-effectiveness  evalua¬ 
tions  will  be  accomplished  in  FY  90-92. 

f.  Multi-Ship  Instructional  Support  System  for 
ACME  (MISS  ACME).  This  is  a  jointly  funded  project 
with  ASD/YW  for  the  development  of  an  instructional 
support  system  for  the  ACME  SAT  facility.  Its  goals 
are  (1)  to  satisfy  the  ACME  SAT  requirements  for  a 
control,  measurement,  mission  planning,  briefing, 
and  debriefing  system;  and  (2)  to  satisfy  generic  IOS 
concept  requirements  for  the  development  and 
validation  of  modular,  transportable  software  for 
multi-ship  instructional  support  systems.  A  three- 
phased  program  is  planned,  leading  to  the  delivery 
of  the  system  and  integration  with  the  ACME  net¬ 
work  in  FY  91.  A  transportability  demonstration  is 
also  planned  for  validation  of  the  generic  IOS  con¬ 
cept. 

g.  Networking.  This  tri-Service  project  will  extend 
the  Army’s  SIMNET  protocol  to  meet  the  com¬ 
munication  requirements  of  flight  simulators  and  will 
specify  the  protocol  as  a  network  standard.  The 
hardware  and  software  components  necessary  to 
implement  the  standard  (both  local  and  long-haul) 
will  then  be  designed  and  developed.  Each  flight 
simulator  that  will  use  the  network  will  be  provided 
the  design  of  these  components,  along  with  en¬ 
gineering  support  to  aid  their  integration.  The 
project  will  also  evaluate  the  performance  of  the 
network,  estimate  the  amount  of  communication 
that  can  be  supported,  and  determine  the  number 
of  interactive  flight  simulators  that  can  operate 
reliably  while  providing  effective  training.  Facilities 
to  be  included  within  this  network  include  the  ACME 
SAT  facility  at  Williams  AFB,  the  VTRS  flight  simula¬ 
tion  complex  at  Orlando,  the  AH-64  research  simula¬ 
tion  complex  at  Ft  Rucker,  and  several  SIMNET 
modules  located  at  Orlando.  The  local  network  to 
link  components  of  the  ACME  R&D  test-bed  facility 
will  be  completed  in  FY  91.  The  long  distance 
network  with  the  other  facilities  will  be  completed  in 
FY  92. 

h.  Reconfigurable  Pilot  Stations.  This  effort  will 
produce  a  low-cost  network  of  reconfigurable  pilot 
stations  that  can  be  used  as  either  (1)  components 
of  the  ACME  R&D  test-bed  facility  or  (2)  stand-alone 
devices  that  can  be  deployed  for  squadron-level 
training.  These  reconfigurable  pilot  stations  must 
enable  the  aircrew  to  perform  the  critical  combat-re¬ 
lated  tasks  that  are  necessary  components  of  realis- 
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tic  mission  scenarios.  The  starting  point  for  their  now  occurring,  it  is  likely  that  such  a  capability  can 

development  is  the  current  configuration  of  the  F-1 6  be  acquired  as  an  off-the-shelf  system.  The  photo- 

Air  Intercept  Trainers.  Additional  capabilities  neces-  texture  IQ  will  generate  high-resolution  visual  im- 

sary  to  support  ACME  requirements  will  be  identified  agery  from  photographic  sources,  thus  enabling  far 

and  incorporated  within  the  systems.  These  pilot  greater  scene  detail  than  is  now  available  with  cur- 

stations  will  eventually  be  retrofitted  with  low-cost  rent  systems.  The  system  must  also  be  capable  of 

visual  image  generation  and  display  systems.  The  generating  correlated  radar  and  infrared  imagery, 

stations  will  use  a  common  network  protocol  and  The  acquisition  of  such  a  system  is  considered  an 

may  be  operated  independently  of  the  ACME  R&D  essential  component  of  the  training  effectiveness 

facility  network,  thus  providing  certain  part-task  research  program  that  addresses  mission  rehears- 

training  opportunities.  These  stations,  in  an  F-1 6  al. 

configuration,  will  be  completed  in  FY  91 .  Software 

to  support  both  F-1 5  and  A-10  simulation  will  be  j.  Rapid  Data  Base  Development.  The  most  impor- 
completed  in  FY  92.  tant  requirement  for  mission  rehearsal  is  likely  to  be 

waypoint  and  target  familiarization.  This,  in  turn, 
i.  Photo-Texture  Image  Generator.  To  provide  a  requires  the  development  of  highly  detailed  and 

mission  rehearsal  capability  within  the  ACME  R&D  accurate  digital  data  bases  for  use  by  a  multispectral 

test-bed  facility,  a  photo-texture  image  generator  image  generator.  Moreover,  it  is  essential  that  these 

(IG)  will  be  acquired  beginning  in  FY  92,  with  data  bases  be  constructed  in  a  relatively  short 

delivery  expected  in  FY  94.  Given  the  rapid  advan-  period  of  time  (e.g.,  24-72  hours).  The  capability  to 

ces  in  visual  image  generation  technology  that  are  develop  such  high-resolution  data  bases  with  at- 


AFHRL  is  researching  data  base  development  to  provide 
detailed  digital  information  necessary  for  image  generation. 
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tributes  necessary  for  infrared,  radar,  and  visual 
simulation  in  such  a  short  period  is  well  beyond  the 
current  state  of  the  art.  AFHRL  is  maintaining  a 
close  technology  watch  on  key  programs  including 
ASD's  Project  2851 ,  which  is  attempting  to  develop 
a  DOD  standard  data  base  and  common  transfor¬ 
mation  software  that  can  be  used  for  simulator  train¬ 
ing  devices  requiring  the  use  of  digital  cartographic 
data.  Under  this  effort,  there  is  also  a  project  being 
funded  by  the  U.S.  Army  for  a  Rapidly  Recon- 
figurable  Data  Base  that  is  to  be  completed  in  FY  90. 
The  results  of  these  technology  efforts  will  be  incor¬ 
porated  into  the  ACME  R&D  test-bed  facility  as  they 
become  available. 

k.  Systems  Integration  Using  Local  Area  Net¬ 
works.  During  FY  93-94,  a  number  of  ACME  com¬ 
ponents  will  be  integrated,  and  the  best  approaches 
will  be  selected.  Evaluative  studies  will  be  initiated 
on  integrated  combat  simulators  that  are  capable  of 
providing  situational  awareness  training  to  a  small 
group  of  pilots  at  the  same  time,  using  a  local  area 
network  to  provide  some  of  the  interactions  be¬ 
tween  pilots,  their  controllers,  opponents,  and  simu¬ 
lated  friendly  forces. 

l.  Long  Distance  Network  Development  and 
Evaluation.  The  local  area  network  system  will  be 
expanded  into  a  long  distance  network  in  FY  95, 
since  the  state  of  the  art  is  expected  to  permit  that 
kind  of  advance  at  that  time.  This  will  permit  pilot 
trainees  in  one  part  of  the  world  (e  g.,  USAFE)  to 
challenge  experts  in  another  part  of  the  world  (e.g., 
the  Red  Flag  training  staff  at  Nellis  AFB)  without 
leaving  their  home  base. 

m.  Training  Deployment  Strategies.  During  FY  96, 
ways  of  deploying  the  ACME  training  systems  will 
be  examined  from  a  cost-effectiveness  point  of  view. 
Simplification  and  weight  reduction  options  will  be 
considered  and  evaluated. 

n.  Advanced  Interface  Studies.  During  FY  96,  a 
number  of  advanced  interface  studies  will  be  con¬ 
ducted  with  the  objective  of  expanding  the  scope  of 
the  ACME  training  system  to  include  Navy  and  Army 
forces.  Work  will  also  be  conducted  to  evaluate  the 
use  of  these  expanded  simulation  programs  to 
evaluate  wargaming  options  and  to  study  the  con¬ 
ditions  under  which  the  development  of  creative 
solutions  to  combat  problems  is  facilitated  by  the 
use  of  simulator  training  devices. 


4.  New  Concepts  in  Aircrew  Training  Systems. 
Although  they  have  not  yet  been  organized  into 
thrusts,  new  concepts  in  aircrew  training  systems 
are  being  developed  at  the  Operations  Training 
Division  as  a  result  of  exploratory  and  advanced 
development  studies. 

Contact:  Dr.  Dee  Andrews 

AFHRL/OTT 

Williams  AFB  AZ  85240-6457 

Commercial:  (602)  988-6561 

AUTOVON:  474-6561 

One  important  probe  study  proposed  is  to  estab¬ 
lish  a  knowledge  base  of  pilot  combat  skills  for  use 
in  aircrew  training.  It  will  include  the  areas  of  air-to- 
air,  air-to-ground,  and  threat  evasion  techniques. 
Artificial  Intelligence  (Al)  will  be  used  to  break  up 
tasks  and  develop  part-task  trainers  that  will  use  Al 
to  optimize  instruction  and  model  performance.  In¬ 
formation  on  tactics  and  execution  will  then  be 
incorporated  into  expert  knowledge  data  bases  for 
use  in  full  mission  simulator  training  exercises.  A 
generalized  Al  model  for  use  in  part-task  trainers  will 
be  developed  in  FY  90.  Expert  systems  for  use  in 
full  mission  simulators  will  be  demonstrated  in  FY 
92. 

5.  Aircrew  Training  Research  Support  Contracts. 

All  of  the  aircrew  training  efforts  are  supported  by 
two  research  support  contracts.  One  contract 
provides  operations,  maintenance  and  program-^, 
ming  support  for  Digital  Image  Generators  (DIGs), 
display  systems,  cockpits,  and  consoles.  These 
contracts  are  competed  every  5  years,  with  the  next 
round  of  competition  scheduled  in  FY  92  for  a  con¬ 
tract  start  in  FY  93.  Another  research  support  con¬ 
tract  provides  quick-response  technical  and 
programming  support  for  in-house  and  contractor 
R&D  efforts.  This  contract  is  normally  competed 
every  3  years.  Rounds  of  competition  during  the  FY 
90-95  timeframe  are  tentatively  scheduled  for  FY  92 
and  FY  95. 

Contact:  Maj  Pat  Mylan 

AFHRL/OTS 

Williams  AFB  AZ  85240-6457 

Commercial:  (602)  988-6561 

AUTOVON:  474-6561 

6.  Command  and  Control  (C2)  Systems  Analysis 
and  Training.  The  evolution  of  the  C2  function  in  the 
Air  Force  is  increasing  both  the  challenge  of  training 
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C2  teams  and  the  payoff  of  such  training.  Future  C2 
systems  will  involve  a  network  of  interdependent 
nodes;  if  some  nodes  are  destroyed  during  combat, 
other  nodes  will  have  to  assume  their  functions.  So, 
the  Air  Force  will  have  to  train  its  C2  teams  to  perform 
a  wide  range  of  functions.  In  addition,  the  com¬ 
plexity  of  battle  management  will  increase.  With  this 
increase  come  additional  requirements  to  provide 
both  realistic  combat  training  ppportuni^’es  and  sys¬ 
tem  design  guidance. 


ing  Center  (CRC).  Facility  modifications  to  support 
studies  of  networked  battle  management  will  be 
completed  in  FY  90.  The  initial  link  to  ACME  will 
occur  in  FY  90  and  be  evaluated  during  FY  91 . 

d.  Training  for  Senior  Battle  Managers.  Beginning 
in  FY  93-  94,  the  Laboratory  will  bring  together  the 
work  on  part-task  trainers  on  high  performance 
skills  and  on  training  for  functionally  distributed  sys¬ 
tems  to  build  a  demonstration  training  system,  fer 
higher-level  battle  managers. 


Contact:  Dr.  Lawrence  E.  Reed 

AFHRIVLRG 

Wright-Patterson  AFB  OH  45433-6503 

Commercial:  (513)  255-8607 

AUTOVON:  785-8607 

Figure  9  is  a  subthrust  roadmap  for 
AFHRL’s  planned  C2  program. 

a.  Training  for  Decision  Making.  This 
continuing  effort  involves  gaining  the 
decision-making  knowledge  of  expert 
battle  managers  through  knowledge  en¬ 
gineering  and  using  it  to  construct  a  com¬ 
puter-based  learning  setting  for  training 
higher-level  decision-making  skills.  A 
prototype  training  system  for  the  Pacific 
Air  Forces  (PACAF)  will  be  completed  in 
FY  90. 

b.  Part-Task  Trainers  for  High  Perfor¬ 
mance  Skiils.  AFHRL  is  developing  a 
new  generation  of  part-task  trainers 
based  on  an  application  of  automated 
information  processing  principles  to  high 
performance  C2  skills.  AFHRL  is  ac¬ 
complishing  the  required  research  on 
skill  retention,  workload  reduction,  and 
transfer  in  FY  89-90.  A  prototype  part- 
task  trainer  for  C2  skills  will  be  built  in  FY 
90  and  evaluated  during  FY  91 . 

c.  Training  for  Functionally  Distributed  Systems. 
This  R&D  uses  wartime  simulations  like  TAC 
THUNDER  to  assess  the  decision  making  of  in¬ 
dividuals  and  teams  working  in  functionally  dis¬ 
tributed  systems.  AFHRL  will  investigate  team 
effectiveness  and  decision  making  under  proposed 
C2  configurations.  Later,  this  effort  will  be  linked  to 
the  Aircrew  Combat  Mission  Enhancement  (ACME) 
program  discussed  above.  Linking  the  two  efforts 
will  allow  emulation  of  an  actual  Control  and  Report  - 


AFHRL  will  build  a  demonstration  training 
system  for  higher-level  battle  managers. 

e.  Training  for  Logistics  C2.  Here  the  goal  is  to 
develop  a  system  to  provide  knowledge-based 
training  in  decision  making  to  logistics  battle  staffs. 
As  now  envisioned,  this  system  will  provide  training 
at  peacetime  duty  stations.  It  will  give  novices  ex¬ 
posure  to  the  complex  decisions  and  variables  as¬ 
sociated  with  wartime  logistics.  Development  of  an 
expert  knowledge  base  will  be  accomplished  in  FY 
90  and  a  demonstration  training  system  will  be 
evaluated  during  FY  91-92. 
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Cf  SYSTEMS  ANALYSIS  AND  TRAINING 
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Fig  9.  Training  Technology  Subthrust  LR-4.  C  Systems  Analysis  and  Training 


f.  Advanced  Models  For  Predicting  Impacts  of  C2 
System  Design  Decisions.  This  effort  will  be  initiated 
in  FY  90  to  expand  and  refine  initial  methods  for 
assessing  the  impact  of  automation  on  the  tactical 
C2  systems  developed  and  demonstrated  in  FY  89. 
These  new  tools  will  provide  predictive  models  and 
systems  emulations  of  a  Tactical  Air  Control  Center 
by  FY  93.  If  feasibility  studies  planned  for  FY  91  are 
encouraging,  this  work  will  be  moved  into  the  6.3 
funded  Simultaneous  Engineering  domain.  There 
AFHRL  will  use  it  to  develop  design  tools  for  predict¬ 
ing  the  "operability  of  new  weapons  systems. 

g.  Microcomputer-Based  Training.  This  activity 
integrates  the  technologies  developed  under  the  6.2 
program  in  training  for  battle  management  and 
focuses  on  training  the  Modular  Control  Equipment 
(MCE)  teams.  It  will  emphasize  job  familiarization, 
decision  making  using  knowledge-based  simula¬ 
tion,  and  team  training.  System  requirements 
analysis  will  be  completed  in  FY90. 


uses  its  training  resources  more  efficiently.  The 
computerized  management  and  delivery  of  training 
could  increase  the  efficiency  of  Air  Force  technical 
training.  So,  AFHRL  has  made  them  the  major  focus 
of  its  technical  training  R&D  program  (sec  roadmap 
at  Figure  10). 

Contact:  Dr.  Scott  Newcomb  (a,  b) 

(IDC) 

AFHRL/IDC 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)536-2242 
AUTOVON:  240-2242 

Maj  Jim  Parlett  (c,  d,  e,  f) 

(Intelligent  Training  Systems) 

AFHRL/IDI 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-2981 
AUTOVON:  240-2981 
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Intelligence  For 


Figure  10  summarizes  how 
AFHRL  plans  to  help  make  com¬ 
puterized  training  a  more  effi¬ 
cient  and  effective  tool  for  the  Air 


Technical  Training 


Force. 

a.  Computer-Based  Training 
(CBT)  Selection  and  Applica¬ 
tion.  Should  I  select  computer- 
based  training  (CBT)  as  the 
medium  for  this  course?  What 
factors  should  I  consider  in 
making  that  decision?  If  I  do 
decide  on  CBT,  how  should  I 
plan  and  execute  a  CBT  pro¬ 
gram?  This  project  addresses 
such  training  planning  ques¬ 
tions.  It  will  explore,  develop, 
and  test  principles  that  will 
guide  the  selection  and  applica¬ 
tion  of  CBT  technologies  in  Air 


The  computerized  management  and  delivery  of  training  Force  technical  training.  This 

will  increase  the  efficiency  of  Air  Force  technical  training.  effort  wil*  Provide  guidance  for 

training  managers  concerning 


7.  Technical  Training  Development  and  Delivery. 
The  Air  Force  could  have  a  technical  training  gap  in 
the  future.  New  weapon  systems  and  new  war-fight¬ 
ing  tactics  wilt  increase  both  the  number  and  the 
complexity  of  the  tasks  that  airmen  must  master. 
But,  training  resources  are  unlikely  to  grow.  The  Air 
Force  can  avoid  a  technical  training  gap  only  if  it 


CBT  course  seiection/conversion  and  CBT  system 
selection.  It  will  deal  with  cost/benefit  analysis,  CBT 
program  planning,  and  risk  assessment.  The 
payoffs  will  include  more  efficient  and  effective  CBT 
program  planning  and  better  use  of  resources 
through  appropriate  CBT  applications. 
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TECHNICAL  TRAINING  DEVELOPMENT  AND  DELIVERY 
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Fig  10.  Training  Technology  Subthrust  ID-1.  Technical  Training  Development  and  Delivery 


c.  Knowledge-Based 
Tools.  The  building  of 
the  first  intelligent  tutor¬ 
ing  system  (ITS)  has 
shown  that  drawing  out 
expertise  from  ex¬ 
perienced  practitioners 
in  a  field  is  an  expensive 
process  The  costs  of 
the  so-called  knowl¬ 
edge  engineering 
process  must  be 
reduced  if  intelligent 
tutoring  systems  are  to 
become  widely  used  in 
the  Air  Force.  This  ef¬ 
fort,  which  is  sponsored 
jointly  by  the  Army  Re¬ 
search  Institute,  the 
Naval  Training  Systems 
Center,  and  AFHRL 
aims  to  bring  down  the 

AFHRL’s  R&D  will  explore,  develop,  and  test  principles  that  will  guide  the  cns,s  of  building  ITSs 
selection  and  application  of  CBT  technologies  in  Air  Force  technical  training.  11  wil1  do  so  by  develop¬ 
ing  software  tools  that 

b  Advanced  it.sfuctional  Design  Advisor  (AIDA).  will  allow  expert  practitioners  with  minimal  instruc- 

The  increased  demand  for  high  quality  training,  tional  design  and  computer  programming  skills  to 

coupled  with  the  scarcity  of  instructional  design  develop  key  parts  of  the  ITS. 

expertise  within  the  military,  has  resulted  in  a  need 

to  automate  the  instructional  design  process.  Prior  d.  Intelligent  Tutoring  Systems.  This  enoa  will 
efforts  to  automate  this  process  have  met  with  develop  several  ITSs  for  Air  Fore"  application  to  fine 

limited  success  because  learning  problems  and  out  what  kinds  of  instructional  si.ategies  and  stu- 

knowledge  types  have 
not  been  comprehensive¬ 
ly  addressed  This  effort 
will  develop  a  set  of  prin¬ 
ciples  which  could  pro¬ 
vide  automated  guidance 
for  novice  courseware 
developers.  Initial 
products  will  be.  (1)  a 
theoretical  framework 
and  prescriptive  instruc¬ 
tional  model,  which  will 
synthesize  previous 
learning  theory:  and  (2) 
courseware  development 
specifications  for  effec 
t/ve  instruction 

The  building  of  the  first  intelligent  tutoring  system  has  shown  that  drawing 
out  expertise  from  experienced  practitioners  is  an  expensive  process. 


dent  interfaces  are  most  effective.  The  Laboratory 
will  also  use  the  ITSs  to  find  out  what  kinds  of 
applications  have  the  highest  payoffs.  An  ITS  for 
space  operations  will  be  completed  in  FY  91 . 


decisions.  They  have  implications  for  Air  Force 
resources.  Moreover,  how  well  the  decisions  are 
made  can  have  large  impacts  on  the  efficiency  and 
effectiveness  of  the  technical  training  systems. 


Decision  support  systems 
consist  of  computerized  job 
aids  for  decision  makers.  They 
can  help  training  decision 
makers  to  reach  better 
decisions  more  rapidly.  Due  to 
the  fact  that  decision  support 
systems  can  both  improve  the 
average  quality  of  decisions 
and  cut  the  costs  of  making 
them,  they  have  a  large  poten¬ 
tial  for  improving  the  efficiency 
and  effectiveness  of  the  Air 
Force’s  technical  training  sys¬ 
tems.  They  offer  opportunities 
to  accomplish  more  with  fewer 
resources. 

Contact:  Maj  Jim  Bushman 
AFHRL/IDE 

Brooks  AFB  TX  78235-5601 
Knowledge  acquisition  is  a  joint-Service  initiative  to  design  and  Commercial.  (512)  536-2932 
develop  intelligent  computer-assisted  instructional  tools  and  techniques.  AUTOVON:  240-2932 


e.  Intelligent  Systems  Test-Bed.  This  work  will 
deliver  a  proof-of-principle  prototype  system  for 
rapid  development  of  ITSs  and  empirical  evaluation 
of  instructional  strategies  for  ITSs.  Called  the  "Rapid 
Prototype  ITS  Development  System  (RAPIDS)",  the 
system  initially  will  be  developed  to  run  on  a  Xerox 
1186.  If  the  initial  version  is  successful,  AFHRL  will 
develop  a  version  that  would  run  on  a  standard  Air 
Force  microcomputer.  The  activity  will  yield  not  only 
RAPIDS  but  also  empirical  information  about  the 
effectiveness  of  different  instructional  strategies  for 
ITSs. 

f.  Integrated  Tutoring  System.  The  rapid  develop¬ 
ment  in  ITS  technology  is  being  paralleled  by  the 
rapid  emergence  of  interactive  visual  training  tech¬ 
nologies.  Once  ITS  technology  matures,  it  will  be 
possible  to  link  ITS  technology  with  interactive  train¬ 
ing  technologies  to  develop  a  multi-media  ITS. 

8.  Technical  Training  Systems  Design.  The  plan¬ 
ning,  implementation,  and  operation  of  systems  for 
technical  training  involve  many  interactive 


Figure  1 1  summarizes  how  AFHRL  is  planning  to 
provide  management  tools  that  could  increase  the 
efficiency  and  effectiveness  of  technical  training  in 
the  Air  Force. 

a.  Job  Aiding/Training.  This  effort  will  explore  and 
develop  methods  to  enhancethe  integration  of  train¬ 
ing  and  aiding  considerations  in  weapon  system 
design  practices.  Now  training  and  aiding  are 
treated  as  independent  methods  to  enhance  human 
performance.  Increased  future  demands  on  its  per¬ 
sonnel  will  prevent  the  Air  Force  from  continuing  to 
view  these  functions  as  independent.  We  know  little 
about  how  job  aiding  and  training  technologies  in¬ 
teract  and  how  they  should  be  interfaced  to  en¬ 
hance  human  performance.  Increased  knowledge 
about  the  interactions  and  interfaces  between  job 
aiding  and  training  will  be  a  key  product  of  this 
activity.  In  addition,  this  effort  will  use  this 
knowledge  to  develop  training  technologies  that 
best  support  advanced  job  aids  like  the  Integrated 
Maintenance  Information  System  (IMIS)  in  FY  92. 
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TECHNICAL  TRAINING  SYSTEMS  DESIGN 
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Fig  11.  Training  Technology  Subthrust  ID-2.  Technical  Training  Systems  Design 


b.  Training  Decisions  System  technology.  The 
Training  Decisions  System  (TDS)  program  aims  to 
develop  a  more  unified  and  integrated  approach  to 
macro-level  training  programming  and  planning. 
The  TDS  integrates  training  requirements,  as  well  as 
manpower  and  cost  considerations,  into  a  single 
comprehensive  model.  The  TDS  uses  information 
about  the  jobs  performed  by  airmen,  about  person¬ 
nel  assignment  flows,  and  about  training  capacities 
to  identify  the  most  cost-effective  training  option 
available.  This  follow-on  research  program  will 
build  upon  earlier  exploratory  development  work 
which  resulted  in  a  proof-of-concept,  computer- 
based,  decision  support  technology.  TDS  is  capable 
of  dealing  with  decisions  about  what  tasks  to  train, 
where  to  train  them,  and  when  in  enlisted  careers  to 
train  them.  The  preliminary  technology  already  has 
been  used  to  address  several  Air  Force  planning 
issues;  they  included  the  impact  of  reduced  TDY-to 
school  funding,  the  impact  of  reduced  Airman  Basic 
Resident  (ABR)  technical  school  funding,  and  the 
resolution  of  resource  capacity  limitations  for  on- 
the-job  training.  The  project  is  scheduled  for  com¬ 
pletion  in  FY  92. 

c.  Training  Requirements  Planning  and  Assess¬ 
ment  Technologies.  This  new  project  will  integrate 
R&D  technologies  resulting  from  the  Training 
Decisions  System  (TDS)  and  Job  Performance 


Measurement  (JPM)  efforts.  This  effort  will  develop 
and  evaluate  the  technologies  related  to  training 
decisions  modeling  and  training  evaluation.  It  will 
provide  the  research  and  development  needed  to 
link  these  technologies.  The  project  will  provide  Air 
For  i  training  planners  with  the  technologies  that 
will  allow  them  to  plan  training  based  on  both  cost 
and  objective  measures  of  job  performance.  This 
project  aims  to  provide  cost-  and  performance- 
based  training  planning  technologies  by  FY  94. 

d.  Performance-Based  Training  Decisions  Sup¬ 
port  Technologies.  The  object  of  tms  advanced 
development  effort  is  to  refine  and  extend  perfor 
mance-based  training  planning  technologies 
developed  with  exploratory  R&D  funds  AFHRL  will 
use  these  training  planning  technologies  to  analyze 
performance  and  cost  issues  based  on  alternative 
task  identification  and  analysis  techniques.  These 
analyses  will  deal  with  multiple  AFSs,  weapon- 
system-specific  AFSs,  and  projected  AFSs  for  future 
weapon  systems.  This  effort  is  scheduled  to  begin 
in  FY  92. 

e.  Training  Evaluation.  This  effort  will  use  tech¬ 
nologies  developed  through  the  job  performance 
measurement  project  to  explore  ways  of  evaluating 
technical  skills  training.  In  particular,  it  will  develop 
methods  for  measuring  individual  performance. 


The  TDS  integrates  training  requirements,  as  well  as  manpower  and 
cost  considerations,  into  a  single  comprehensive  model. 
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The  Job  Performance  Measurement  project  will  assess  the  ability  of 
various  measurement  systems  to  identify  the  most  cost-effective 
methods  for  collecting  reliable  job  performance  information. 


Such  measures  will  allow  training  managers/ 
developers  to  assess  accurately  student  achieve¬ 
ment,  transfer  of  knowledges  and  skills  to  the  job 
setting,  and  the  efficiency  of  training  program 
design.  Training  managers/developers  will  be  able 
to  identify  areas  of  potential  over-  or  under-training. 
Preliminary  development  of  the  performance-based 
training  evaluation  system  is  expected  to  be  com¬ 
pleted  by  FY  94. 

f.  Job  Performance  Measurement  (JPM).  This 
project  builds  upon  prior  exploratory  research  ef¬ 
forts  in  which  AFHRL  developed  multiple  measures 


of  individual  performance  and  administered  them  to 
over  1 ,400  first-term  airmen  in  eight  enlisted  special¬ 
ties.  The  project  now  involves  data  analysis  to 
determine  the  relationship  between  ASVAB  scores 
and  job  performance  capability  Additionally,  the 
research  will  assess  the  ability  of  various  measure¬ 
ment  systems  to  identify  the  most  cost-effective 
methods  for  collecting  reliable  job  performance  in¬ 
formation.  The  Laboratory  is  exploring 
methodologies  for  setting  classification  standards 
based  on  a  job  performance  criterion.  Analysis  will 
conclude  in  FY  92. 
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VI.  PROGRAM  RELATIONSHIPS 


AFHRL  is  actively  working  to  reduce  unnecessary 
duplication  of  R&D  efforts  by  participating  in  a  tri- 
Service  commanders  meeting  with  the  Army  Re¬ 
search  Institute  (ARI)  and  the  Navy  Personnel 
Research  and  Development  Center  (NPRDC). 
Meetings  are  held  quarterly,  at  which  time 
programs  are  reviewed  and  joint  initiatives  are 
planned. 

AFHRL  also  exchanges  technology  with  allies 
through  several  programs.  The  Technical  Coopera¬ 
tion  Program  (TTCP)  provides  for  the  exchange  of 
information  in  the  area  of  behavioral  sciences  with 
the  United  Kingdom,  Canada,  Australia,  and  New 
Zealand.  AFHRL  contributes  to  the  North  Atlantic 
Treaty  Organization  (NATO)  by  participating  in  the 
Psychological  Fitness  Study  Group  (AFHRL/MO), 
Manned  Communications  Interaction  in  Command 
and  Control  Panel  (AFHRL/LR),  and  the  Aircrew 
Selection  Working  Group  (AFHRL/MO).  AFHRL 
also  has  aircrew  selection  data  exchange  programs 
with  the  United  Kingdom,  Germany,  and  Australia. 
These  programs  will  provide  data  needed  to  help 
validate  tests  developed  at  AFHRL. 

With  the  expected  decline  of  the  service-eligible 
population  in  the  1990  timeframe,  all  the  Armed 
Services  are  facing  problems  in  attracting  sufficient 
numbers  of  eligible  personnel  into  military  service. 
Ways  of  enhancing  productivity  of  the  workforce 
and  retaining  a  quality  career  force  are  also  high 
priority  items.  Based  on  the  similarity  of  service 
issues  and  concerns,  several  tri-Service  R&D  work¬ 
ing  groups  have  been  established  to  develop  in¬ 
tegrated  and  cooperative  R&D  programs  to  study 
these  mutual  problems.  An  example  is  the  Joint 
Services  Selection  and  Classification  Working 
Group  (sponsored  by  OASD  (FM&P)-AP)  and  its 
associated  Technical  Task  Group.  These  two  work¬ 
ing  groups  plan  a  comprehensive  program  for  the 
development  and  validation  of  enlisted  operational 
and  high  school  testing  programs.  Systematic  tech¬ 
nical  coordination  is  attained  through  group  plan¬ 
ning  sessions  and  the  exchange  of  contract  and 
in-house  R&D  proposals.  A  cooperative  service 
project  to  plan,  develop,  and  implement  an  adaptive 
testing  program  is  currently  being  pursued  through 
membership  on  the  Computerized  Adaptive  T esting 
Interservice  Coordinating  Committee  (CATICC). 
Finally,  an  inter-Service  R&D  working  group  was 


established  to  focus  on  the  development  of  on-the- 
job  performance  measures  to  be  used  in  the  valida¬ 
tion  of  service  selection  programs. 

AFHRL  maintains  active  technical  coordination 
with  the  Wright  Research  and  Development  Center 
(WRDC),  Logistics  Management  Center  (LMC), 
Aeronautical  Systems  Division  (ASD),  Armstrong 
Aerospace  Medical  Research  Laboratory  (AAMRL), 
Acquisition  Logistics  Division  (ALD),  and  Rome  Air 
Development  Center  (RADC).  Reliability, 
Availability  and  Maintainability  in  Computer  Aided 
Design  (RAMCAD),  Aircraft  Battle  Damage  Repair, 
and  Simultaneous  Engineering  are  major  projects 
AFHRL  is  jointly  working  with  WRDC.  Participants 
with  AFHRL  in  the  development  of  RAMCAD  include 
other  Air  Force  agencies  (WRDC,  RADC,  and  ASD 
System  Program  Offices  [SPOs]).  Other  par¬ 
ticipants  in  RAMCAD  R&D  include  the  Naval  Ocean 
Systems  Center,  the  Fort  Belvoir  RD&E  Center,  and 
the  Picatinny  Arsenal  through  the  Joint  Logistics 
Commanders’  RAMCAD  working  group.  AFHRL  is 
working  with  the  David  Taylor  Naval  Ship  R&D  Cen¬ 
ter  on  a  DOD  Standard  for  digital  data.  The  human 
model  in  computer-aided  design  is  a  joint  project 
between  AFHRL  and  AAMRL.  AFHRL  personnel  are 
members  of  the  Joint  Policy  Coordinating  Group  for 
Logistics  Research,  Test,  and  Evaluation  plus 
several  joint-Service  subgroups  such  as  the  RAM¬ 
CAD  panel.  Close  coordination  is  being  maintained 
with  agencies  that  will  use  the  products  developed 
by  AFHRL  R&D.  A  formal  Memorandum  of  Agree¬ 
ment  between  ALD  and  AFHRL  has  been  signed  to 
promote  orderly  transitions  of  R&D  products.  As 
part  of  the  agreement ,  an  ALD  officer  is  collocated 
at  the  Logistics  and  Human  Factors  Division 
(AFHRL/LR)  to  assist  in  the  transitioning  process. 

Team  Training  Systems  research  is  also  coor¬ 
dinated  with  many  agencies.  Close  liaison  is  main¬ 
tained  with  elements  of  the  Tactical  Air  Command, 
including  support  of  Blue  Flag  exercises  and  the 
Joint  Warfare  Center.  Systematic  technical  coor¬ 
dination  is  maintained  with  the  Army  and  Navy 
through  international  programs  such  as  The  Tech¬ 
nical  Cooperation  Program  (TTCP).  Active  interface 
is  maintained  with  AAMRL’s  work  on  console  design 
and  man-machine  interfaces.  Work  achieving  a 
comprehensive  training  capability  for  tactical  com¬ 
mand  and  control  teams  is  coordinated  with  RADC, 
Electronic  Systems  Division,  4441st  Tactical  Train¬ 
ing  Group  (Blue  Flag),  Air  Ground  Operations 
School,  Air  University,  PACAF,  USAFE,  Ninth  Air 
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Force.  Twelfth  Air  Force,  HQ  AFSC,  Air  Staff,  and 
selected  Army  and  Navy  organizations.  Research 
on  human  information  processing  is  conducted 
jointly  with  RADC.  AFHRL’s  program  is  unique  in  its 
emphasis  on  training  and  technology  for  battle  staff 
members  and  commanders. 

AFHRL  cooperation  with  NAVAIR  and  the  Naval 
Training  Systems  Center  (NTSC)  led  to  the  develop¬ 
ment  of  a  Universal  Threat  System  for  Simulators 
(UTSS)  concept  to  address  common  Air 
Force/Navy  problems  in  threat/electric  warfare  (EW) 
subsystems  development,  acquisition,  validation, 
and  maintenance.  The  UTSS  project  will  develop  a 
standard  data  base  of  threat  and  electronic  warfare 
models  for  real-time  flight  simulation  applications. 

A  tri-Service  effort  in  networking  technology  sup¬ 
ports  the  ACME  program.  A  simulator  network 
standards  working  group  has  been  established, 
consisting  of  representatives  of  industrial  firms  as 
well  as  representatives  from  AFHRL,  NTSC,  PM- 
TRADE,  ARI,  and  DARPA.  One  of  its  objectives  is  to 
help  accomplish  interactive  flight  simulation.  The 
Army  protocol  for  SIMNET  will  be  extended  to  meet 
the  communication  requirements  of  high-perfor¬ 
mance  flight  simulators.  The  payoff  will  be  a  stand¬ 
ard  communication  network  that  all  services  can 
use  to  accomplish  multi-force  combat  simulation. 

Continuous  technical  exchange  and  coordination 
are  also  maintained  in  methodologies  to  support 
training  system  development,  initial  skills  training, 
and  on-the-job  training  (OJT).  Liaison  is  maintained 
with  pertinent  industrial  and  educational  programs. 
AFHRL  is  working  with  the  Navy,  Army,  and  several 
academic  centers  to  coordinate  Air  Force  Al  pro¬ 
gram.  One  project  (now  complete)  jointly  spon¬ 
sored  by  the  Naval  Training  Systems  Center 
(NTSC),  ARI,  and  AFHRL  was  to  develop  a  student 
diagnostic  model  along  with  knowledge  acquisition 
tools  and  authoring  aids  for  applying  the  model  to 
training  domains.  As  a  result  of  this  tri-service  effect, 
AFHRL  is  increasing  its  efforts  concerned  with  com¬ 
puter  assisted  knowledge  engineering  tools  and 
techniques. 


The  Canadian  and  United  States  Governments  are 
operating  under  a  50/50  cost-sharing  agreement  to 
develop  a  fiber  optic  helmet-mounted  display 
(FOHMD).  The  FOHMD  offers  an  impressive  advan¬ 
cement  in  display  system  technology  with  sig¬ 
nificant  increases  in  brightness  and  resolution  at  a 
substantial  cost  savings  over  conventional  dome 
and  dodecahedron  displays.  The  Navy  (NTSC)  is 
working  on  a  competing  design  and  both  will  be 
ready  for  evaluation  in  the  FY  90  timeframe.  AFHRL 
is  also  working  with  ARI  and  the  DOD  Training  and 
Performance  Data  Center  (TPDC)  to  develop  expert 
systems  for  use  by  training  system  designers. 

R&Dto  develops  pilot  performance  measurement 
system  is  being  accomplished  by  the  Air  Force,  the 
Navy,  the  National  Aeronautics  and  Space  Ad¬ 
ministration,  the  University  of  Illinois,  and  the  Royal 
Air  Force.  In  addition,  the  Army  has  several  related 
research  projects  in  the  area  of  combat  simulation, 
including  work  on  a  low-level  sponsor  target  iden¬ 
tification  system  for  attack  helicopters. 

Both  the  Army  and  the  Navy  have  ongoing  re¬ 
search  in  simulator  effectiveness  and  are  working 
jointly  on  the  development  of  microprocessor- 
based  part-task  trainers  with  advanced  interactive 
display  capabilities.  A  tri-Service  effort  is  also  un¬ 
derway  to  develop  standard  data  base  formats  for 
visual  CIG  systems  (Project  2851 ,  ASD/YWB).  Con¬ 
tinuous  coordination  is  maintained  with  the  Defense 
Mapping  Agency  on  terrain  presentation  for  low- 
level  navigation  and  air-to-ground  simulation. 

Every  year,  AFHRL  actively  participates  in  the 
review  and  evaluation  of  the  Independent  Research 
and  Development  (IR&D)  programs  of  industry.  The 
scope  of  AFHRL’s  activities  is  illustrated  by  the 
actions  that  took  place  during  the  past  year.  AFHRL 
reviewed  54  company  IR&D  technical  plans  and 
found  206  projects  (out  of  265)  relevant  to 
Laboratory  programs.  The  total  company  funds 
invested  in  these  206  projects  was  impressive- 
$86. 7M.  This  is  an  increase  from  FY  88,  when 
AFHRL  reviewed  184  IR&D  projects  with  a  total 
company  investment  value  of  $62.8M. 
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Table  1.  Investment  Areas  Supported  by  IR&D  Efforts. 


Investment  Area 

Cost 

Percent 

Aircrew  training  and  simulation  devices 

$30.5M 

35.2 

Information  and  computational  sciences 

$20.5M 

23.6 

Technical  training  and  artificial  intelligence 

$18.6M 

21.5 

Logistics  and  C2  Systgems 

$17.0M 

19.6 

Manpower  and  personnel  systems 

$0.1  M 

0.1 

Total 

$86. 7M 

100.0 

The  larger  investments  at  the  top  of  the  list  reflect  the  cost  of  expensive 
computer,  simulation,  and  information  systems  needed  to  conduct  the  IR&D. 
The  lowest  investment  area  (manpower  and  personnel)  reflects  another  reality 
of  the  marketplace.  There  is  not  much  of  a  market  outside  the  military  for 
large-scale  manpower  and  personnel  systems  of  the  type  used  by  the  Air 
Force. 
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VII.  ACCOMPLISHMENTS 


Recent  AFHRLaccomplishments  are  summarized 
below  by  Technical  Area. 

Manpower  and  Force  Management 

1.  Prototype  Job  Tutor.  This  effort  resulted  in  a 
successful  and  unprecedented  field  test  of  an  intel- 
ligent  tutoring  system  for  F-15  avionics 
troubleshooting  for  one  AFSC.  Results  support 
claims  that  a  cognitive  theory-based  training  sys¬ 
tem  is  effective  in  teaching  complex  cognitive  skills 
(i.e.,  troubleshooting),  that  experience  can  be  ac¬ 
celerated  (20  hours  of  training  boosted  experience 
levels  by  as  much  as  3.5  years),  and  that  a  com¬ 
puter-based  instructional  approach  is  effective  for 
avionics  troubleshooting. 

PLANNED  USERS:  HQ  TAC/LGQ,  HQ 
AFCC/LGM,  ATC  Tech  Training  Centers, 
USAFOMC. 

CONTACT:  Dr.  Sherrie  Gott 
AFHRL/MOMJ 
Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-3942 
AUTOVON  240-3942 

2.  Transitioning  of  Methodology  for  Generating 
Efficiency  and  Effectiveness  Measures  (MGEEM). 
The  MGEEM  is  a  multi-step  productivity  measure¬ 
ment  and  enhancement  procedure.  It  is  designed 
to  bring  the  managers  and  workers  of  an  organiza¬ 
tion  to  consensus  about  thp  principal  intended  ac¬ 
complishments  of  the  oi  anization  called  "Key 
Result  Areas  (KRAs),"and  means  of  measuring  each 
KRA,  called  "indicators."  Once  the  indicators  are 
developed.  MGEEM  then  graphically  links  them  to 
levels  of  effectiveness  on  specifically  designed 
charts.  Multiple  indicators  and  units  can  be  ag¬ 
gregated  upward  to  derive  higher-level  organiza¬ 
tional  productivity  measures.  Data  to  support  the 
indicators  come  from  existing  management  infor¬ 
mation  and  reporting  systems.  Feedback  to 
employees  and  supervisors  can  improve  produc¬ 
tivity  and  ensure  that  the  Total  Quality  Management 
philosophy  of  continuous  process  improvement  is 
an  integral  part  of  any  organization.  The  MGEEM  is 
being  transitioned  to  the  Air  Force  Management 
Engineering  Agency  (AFMEA)  to  support  implemen¬ 


tation  of  AFR  25-5,  Air  Force  Management  Engineer¬ 
ing  Program. 

PLANNED  USERS:  AFMEA,  ESC,  AFOSR,  AFLC, 
Navy. 

CONTACT:  Lt  Malcom  Upton 
AFHRL/MOMD 
Brooks  AFB  TX 
Commercial  (512)  536-3942 
AUTOVON  240-3942 

3.  ASVAB  Forms  15,  16,  and  17.  The  Armed 
Sen/ices  Vocational  Aptitude  Battery  (ASVAB)  is  the 
primary  enlisted  selection  and  classification  test  for 
the  United  States  Armed  Services.  New  versions  of 
the  test  must  be  developed  on  a  regular  basis. 
During  FY  88,  raw  scores  on  ASVAB  Forms  15, 16, 
and  17  were  converted  to  operational  scores  for  all 
services'  selection  and  classification  composites, 
using  recruit  data.  These  conversions  will  be 
evaluated  using  operational  scores  from  applicant 
samples. 

PLANNED  USERS:  HQ  USAF/DPXOA,  USMEP- 
COM. 

CONTACT:  Dr.  Malcolm  Ree 
AFHRL/MOA 

Brooks  AFB  TX  78235-5601 
Commercial  (512)  536-3256 
AUTOVON  240-3256 

4.  Armed  Forces  Qualification  Test  (AFQT).  The 
Office  of  the  Assistant  Secretary  of  Defense  (OASD) 
/FM&MP)  requested  a  new  test  composite  to 
replace  the  AFQT.  Through  the  use  of  regression 
analyses  and  cross-tabulations,  a  new  AFQT  was 
developed  by  AFHRL/MO  and  accepted  by  the 
OASD  for  use  in  Armed  Forces  military  qualification 
determinations. 

PLANNED  USERS:  USAF/DPXOA,  OASD 
(FM&MP),  HQ  USMEPCOM,  CNO,  HQ  USA,  HQ 
USMC. 

CONTACT:  Dr.  Malcolm  Ree 
AFHRL/MOA 

Brooks  AFB  TX  78235-5601 
Commercial  (512)  536-3256 
AUTOVON  240-3256 
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5.  Selection  and  Classification  Porta-BAT  Data 
Base.  The  Portabat  is  a  portable  version  of  the  Basic 
Aptitudes  Test  (BAT)  battery.  During  FY  88,  the  test 
base  for  the  Porta-BAT  was  expanded  to  35  tests 
and  8  were  validated  against  Undergraduate  Pilot 
Training  (UPT)  pass/fail  or  the  advanced  Training 
Recommendation  Board’s  Fighter/Attack/Recon¬ 
naissance  (FAR)  decision.  Two  models,  one  for 
selection  and  one  for  classification,  were  developed 
and  will  be  used  (by  HSD/YA)  to  baseline  an  up¬ 
dated  Porta-BAT  model  being  acquired  as  part  of  a 
Pilot  Selection  and  Classification  System  (PSACS). 
Plans  are  to  expand  the  data  base  to  include  more 
operational  unit  test  results.  This  system  will  be 
transitioned  to  ATC  in  1991  and  used  to  select  and 
classify  Air  Force  pilots  for  the  Specialized  Under¬ 
graduate  Pilot  Training  program. 

PLANNED  USERS:  HQ  ATC,  DCS  Technical 
Training,  Air  National  Guard,  EURO-NATO  Aircrew 
Selection  Working  Group. 

CONTACT:  Maj  Dave  Perry 

AFHRL/MOEA 

Brooks  AFB  TX  78235-5601 

Commercial  (512)  536-3222 

AUTOVON  240-3222 

6.  Learning  Abilities  Measurement  Program 
(LAMP)  Automated  Testing  System  (LATS).  The 
LATS  is  a  software  tool  for  the  development  of 
computer-administered  experimental  cognitive 
tests.  LATS  is  written  in  Turbo  Pascal  and  is  imple¬ 
mented  on  the  Zenith  248  microcomputer.  LATS 
enables  a  psychologist  to  develop  automated  cog¬ 
nitive  tests  for  the  assessment  of  information 
processing  abilities  (processing  speed,  attention, 
memory,  perception)  and  various  cognitive  skills. 
LATS  tests  are  fully  automated  with  respect  to  in¬ 
structions,  administration,  data  collection,  and  data 
reduction.  At  the  heart  of  LATS  is  a  "driver”  program 
which  understands  a  custom-made,  high-level 
programming  language.  Because  this  language 
can  describe  complex  sequences  of  stimulus 
presentation  and  stimulus  contingencies,  a  wide 
variety  of  cognitive  tests  can  and  have  been  imple¬ 
mented.  LATS  will  continue  to  evolve  as  the  needs 
of  LAMP  stretch  the  limits  of  the  system. 

PLANNED  USERS:  Navy  -  NPRDC;  AFHRL  -  to 
enhance  technology  base. 

CONTACT:  Dr.  William  C.  Tirre 


AFHRL7MOEL 
Brooks  AFB  TX  78235-5601 
Commercial  (512)  536-3570 
AUTOVON  240-3570 

7.  Accession/Retention  Model.  Accession/reten¬ 
tion  research  encompasses  three  different  efforts  to 
gain  insight  into  the  impact  of  economic  factors  on 
retention  and  accession.  The  results  of  a  study  on 
the  retention  of  airmen  in  various  Air  Force  special¬ 
ties  were  used  to  develop  the  Air  Force  Reenlistment 
Analysis  Package  (AFRAP).  AFRAP  forecasts  the 
impact  of  changes  in  bonuses,  relative  wages,  and 
demographic  factors,  and  predicts  the  effects  these 
changes  will  have  on  the  retention  of  airmen.  Two 
other  personnel  market  studies  are  the  Joint  Acces¬ 
sion/Retention  Study  (which  looks  at  how  accession 
and  retention  are  jointly  determined),  and  the 
Civilian  Availability  Study  (which  estimates  the  num¬ 
ber  and  skills  of  the  civilians  that  the  Air  Force 
needs). 

PLANNED  USERS:  HQ  USAF/DPXA, 

OASD(FM&MP). 

CONTACT:  Mr.  Larry  T.  Looper 
AFHRL/MOMD 
Brooks  AFB  TX  78235-5601 
Commercial  (512)  536-3942 
AUTOVON  240-3942 


Logistics  Technology 

1.  Design  Analysis  Models  (Crew  Chief).  Crew 
Chief  is  a  computer-based  anthropometric  com¬ 
puter  graphics  design  and  analysis  tool.  It  provides 
a  data  base  containing  information  about  Air  Force 
technicians  (male  and  female)  for  use  in  computer- 
aided  methods  to  evaluate  designs  of  weapon  sys¬ 
tems  and  equipment.  The  model  is  used  to  evaluate 
new  weapon  systems  and  equipment  designs. 
Human-like  positions/  movements  such  as  stand¬ 
ing,  sitting,  squatting,  crawling,  lifting,  pulling,  and 
tool  usage  are  featured  in  the  model.  This  effort 
encompasses  both  male  and  female  technicians  in 
both  standard  work  clothes  and  the  protective  en¬ 
semble.  The  model  can  evaluate  a  proposed  design 
in  maintainability  terms  such  as  accessibility  of 
equipment,  tool  usage  within  access  areas,  main¬ 
tenance  operations  and  task  requirements,  and  load 
lifting  requirements.  It  can  be  used  by  designers  to 
do  on-line  analysis  during  early  stages  of  the  design 
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cycle.  A  prototype  version  of  the  model  has  been 
released  to  industry. 

PLANNED  USERS:  ASD,  Air  Force  Acquisition 
Logistics  Division  (AFALD),  Industry;  NASA  has  ex¬ 
pressed  interest  in  these  tools  for  use  in  analysis  of 
space  operations 

CONTACT:  Ms.  Jill  Easterly 
AFHRL/LRA 

Wright-Patterson  AFB  OH  45433-6503 
Commercial  (513)  255-6718 
AUTOVON  785-671 8 

2.  Unified  Data  Base  (UDB)  for  Acquisition  Logis¬ 
tics.  The  UDB  is  a  Logistics  Support  Analysis 
Record  (LSAR)  data  base  designed  to  improve  the 
documentation  and  accessibility  of  acquisition 
logistics  support  data.  UDB  provides  a  data  infor¬ 
mation  and  decision  support  system  which  enables 
logisticians  and  engineers  to  rapidly  document, 
retrieve,  and  query  a  central  data  base  on-line  via  a 
computer  terminal.  UDB  conforms  to  MIL-STD- 
1 388-2A  and  automates  all  the  data  elements  of  this 
standard  through  the  addition  of  data  elements  sup¬ 
plemental  to  the  military  standard.  The  system  may 
also  be  used  to  automate  common  acquisition  data 
items.  The  UDB  has  been  transitioned  to  AFALD. 

PLANNED  USERS:  AFALD,  Navy. 

CONTACT:  Mr.  Johnlanni 
AFHRL/LRA 

Wright-Patterson  AFB  OH  45433-6503 
Commercial  (513)  255-3871 
AUTOVON  785-3871 

3.  Content  Data  Model  (CDM).  The  CDM  provides 
structure  to  the  rapidly  developing  world  of  digital 
data  bases  and  electronic  information  systems,  it 
describes  in  one  cohesive  model  all  types  of  infor¬ 
mation  that  could  be  required  to  maintain  any  given 
vehicle.  Important  goals  include  providing  an  inter¬ 
change  and  validation  structure  for  any  information 
which  may  be  passed  between  automatic  systems 
that  operate  on  different  software  or  hardware; 
providing  a  generic  model  for  any  future  information 
or  vehicles  which  might  be  included  in  an  electronic 
system;  and  allowing  repetitive  or  shared  data  to  be 
stored  only  once  in  any  electronic  storage  system. 
The  technology  intent  is  to  make  the  information 
independent  of  the  implementation.  The  CDM  is 
being  coordinated  with  the  DOD  CALS  Working 


Group  and  is  expected  to  become  a  CALS  standard. 
PLANNED  USERS:  AFSC,  DOD-wide,  Industry. 


CONTACT:  Mr.  David  Gunning 
AFHRL/LRC 

Wright-Patterson  AFB  OH  45433-6503 
Commercial  (513)  255-3771 
AUTOVON  785-3771 

4.  Product  Data  Control  Model  (PDCM).  In¬ 
tegrated  Design  Support  (IDS)  is  an  R&D  program 
to  improve  the  management  of  the  technical  data 
associated  with  major  Air  Force  weapon  systems. 
The  PDCM  is  the  cornerstone  upon  which  IDS  is 
being  built.  The  PDCM  defines  all  the  data  entities 
and  their  logical  inter-relationships  needed  to  pro¬ 
vide  weapon  system  engineering  support.  The 
PDCM  provides  the  framework  for  data  integration 
by  defining  how  the  enterprise-wide  engineering, 
manufacturing,  and  operations  support  products 
relate  from  the  viewpoint  of  critical  data.  The  PDCM 
serves  as  a  bridge  between  the  user  and  the 
hardware  system,  freeing  the  user  from  needing  to 
know  where  or  how  the  particular  data  one  wishes 
to  access  are  stored.  The  PDCM  is  unique  to  in¬ 
dustry  and  has  been  acknowledged  as  one  of  the 
first  models  of  its  kind  that  allows  one  to  capture, 
manage,  maintain,  and  retrieve  all  the  technical  data 
pertaining  to  a  product.  This  advanced  data  base 
management  system  technology  representation 
has  been  highly  acclaimed  by  the  engineering  com¬ 
munity  for  its  neutral  and  logical  view,  and  is  actively 
being  studied  for  implementation  within  AFALD, 
NASA,  the  US  Department  of  Transportation,  and 
various  aerospace  organizations  including  Boeing, 
Martin  Marietta,  General  Dynamics,  Rockwell,  and 
Lockheed,  it  is  also  playing  a  significant  role  in 
national  product  data  standards  development. 

PLANNED  USERS:  ASD,  Industry. 

CONTACT:  Mr.  Mark  Hoffman 
AFHRL7LRA 

Wright-Patterson  AFB  OH  45433-6503 
Commercial  (513)  255-671 8 
AUTOVON  785-6718 

5.  Maintenance  Diagnostic  Aiding  System 
(MDAS).  An  important  function  of  the  Integrated 
Maintenance  Information  System  (IMIS)  will  be  its 
ability  to  aid  the  maintenance  technician  in 
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troubleshooting  weapon  systems.  MDAS  is  a  tool 
that  closely  models  how  equipment  behaves  under 
failure  and  it  suggests  the  best  diagnostic  or  repair 
options  to  the  technician  during  troubleshooting. 
MDAS  rank-orders  available  tests  by  finding  the  test 
which  splits  the  set  of  suspected  faults  so  that  the 
probability  of  failure  for  those  faults  being  tested  is 
approximately  equal  to  the  failure  probability  of 
those  not  tested.  Probabilities  are  based  on  Mean 
Time  to  Failure.  Test  times  are  then  considered  so 
that  tests  requiring  the  shortest  time  are  moved  to 
the  top  of  the  list  of  recommended  tests,  all  other 
things  equal. 

PLANNED  USERS:  ASD,  Industry. 

CONTACT:  Mr.  David  Gunning 

AFHRL/LRC 

Wright-Patterson  AFB  OH  45433-6503 

Commercial  (513)  255-3771 

AUTOVON  785-3771 

6.  Authoring  and  Presentation  System  (APS).  The 
APS  was  developed  in  support  of  the  Integrated 
Maintenance  Information  System  (IMIS),  which  will 
provide  technicians  with  direct  access  to  several 
maintenance  information  systems  and  data  bases. 
A  fundamental  requirement  for  IMIS  to  succeed  is 
the  ability  to  author,  find,  merge,  sort,  update,  and 
display  graphics  and  technical  information.  APS 
provides  the  means  to  generate,  store,  organize, 
retrieve,  and  display  electronic  technical  order  infor¬ 
mation.  The  APS  data  base  provides  the  flexibility 
required  to  represent  the  complex  interrelated  data 
found  in  technical  orders. 

PLANNED  USERS:  ASD,  Industry. 

CONTACT:  Mr.  David  Gunning 

AFHRL/LRC 

Wright-Patterson  AFB  OH  45433-6503 

Commercial  (513)  255-3771 

AUTOVON  785-3771 

7.  Threat  System  Relative  Lethality  Values.  The  Air 
Staff  and  HQ  TAC  requested  statistical  support  in 
the  development  of  threat  system  relative  lethality 
values  for  a  Tactical  Air  Forces  Mission  Planning 
System  (TAF  MPS).  TAF  MPS  is  an  automated 
system  that  integrates  weapons  delivery,  flight  plan¬ 
ning,  and  penetration  analysis  to  select  preferred 
routes  through  a  battlefield.  The  amount  of  time 
available  for  flight  planning  is  becoming  shorter  as 


targets  become  more  mobile.  The  TAF  MPS  algo¬ 
rithm  is  designed  to  emulate  the  expert  flight  plan¬ 
ner,  with  a  much  shorter  response  time.  Air 
Force-wide  agreed-upon  relative  lethality  values  for 
certain  surface-to-air  missiles  and  radar-directed 
guns  as  a  function  of  range  and  altitude  do  not  exist. 
To  identify  these  values,  AFHRL  provided  consult¬ 
ative  support  in  the  development,  administration, 
and  analysis  of  a  survey  which  captured  the  policies 
of  experienced  personnel  in  rating  the  relative  effec¬ 
tiveness  of  certain  ground-to-air  weapon  systems. 
The  sample  of  expert  raters  was  comprised  of  44 
pilots,  navigators,  electronic  warfare  officers,  and 
nonrated  personnel  from  various  intelligence  and 
operational  organizations.  AFHRL  performed  inter¬ 
rater  reliability  analysis  to  determine  the  degree  of 
interrater  agreement.  AFHRL  then  computed 
descriptive  statistics  and  performed  curve  fitting 
analyses  to  describe  relative  lethality  as  a  function 
of  range  for  each  altitude/threat  system  combina¬ 
tion.  This  work  provided  TAC  with  the  threat  system 
relative  lethality  data  necessary  to  make  the  TAF 
MPS  operational. 

PLANNED  USER:  TAC. 

CONTACT:  Mr.  Walter  Albert 
AFHRL/MODM 
Brooks  AFB  TX  78236-5601 
Commercial  (512)  536-3648 
AUTOVON  240-3648 

Training  Technology 

1.  Rehosting  of  Instructional  Support  System 
(ISS).  ISS  is  a  computer-based  tool  for  develop¬ 
ment,  delivery,  and  management  of  training  instruc¬ 
tions.  It  operates  on  the  Digital  Equipment 
Corporation  (DEC)  VAX  family  of  computers,  rang¬ 
ing  from  a  MicroVAX  II  to  an  8600,  under  the  Virtual 
Memory  System  (VMS)  operating  system.  AFHRL 
extended  ISS  as  an  Ada  research  activity  to  port  a 
mainframe-based,  hardware-dependent  CBT  sys¬ 
tem  to  a  minicomputer  and,  so,  to  achieve  hardware 
independence.  The  Laboratory  rehosted  ISS  to  the 
Zenith  248  (2nd  quarter  FY  88).  The  rehosting 
provided  Air  Force  and  DOD  users  a  standardized, 
low-cost,  Government-owned  training  system. 
Recent  additions  to  ISS  include  videodisc,  micro- 
Computer-Managed  Instruction  (CMI),  enhanced 
system  documentation,  and  stand-alone,  export¬ 
able  CA!  and  CMI  training  materials. 
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PLANNED  USERS:  SAC,  AFIT,  AFLC,  HSD,  ESD, 
NASA,  AFSC,  ASD,  Army,  Navy. 

CONTACT:  Ms.  Barbara  Eaton 

AFHRL/IDC 

Brooks  AFB  TX  78235-5601 

Commercial  (512)  536-2242 

AUTOVON  240-2242 

2.  Enhancement  of  Maintainer’s  Associate  Train¬ 
ing  Instructional  Environment  (MATIE  II).  The 
Laboratory  enhanced  a  previously  developed  ex¬ 
pert  system  for  maintenance  training  (MATIE  I).  The 
enhancements  permitted  the  further  development  of 
an  Intelligent  Tutoring  System  (ITS)  based  upon  the 
maintenance  knowledge  domain.  Two  research  is¬ 
sues  were  considered  in  the  development  of  this 
ITS.  First  was  an  examination  of  the  issues  involved 
in  adapting  an  expert  system  to  the  role  of  an  expert 
module  in  an  ITS.  Second  was  the  feasibility  of 
developing  a  generic  ITS  that  could  deal  with 
knowledge  domains  in  other  troubleshooting  and 
training  areas.  The  lessons  learned  from  MATIE  II 
are  expected  to  influence  the  design  of  several 
future  ITSs. 

PLANNED  USERS:  ATC  Technical  Training 
Centers. 

CONTACT:  Capt  K«vin  Kline 

AFHRL/IDI 

Brooks  AFB  TX  78235-5601 

Commercial  (512)  536-2981 

AUTOVON  240-2981 

3.  Challenger.  The  goal  of  this  R&D  was  to 
develop  a  prototype  Intelligent  Tutoring  System 
(ITS)  for  use  in  knowledge  domains  having  many 
mathematical  formulae.  The  Laboratory  developed 
a  course  in  Orbital  Dynamics  using  a  prototype 
tutoring  system.  The  five  goals  for  the  Phase  1  effort 
were:  (1)  to  determine  the  properties  that  make  a 
training  domain  suitable  for  ITS  applications;  (2)  to 
develop  an  intelligent  and  powerful  human-com¬ 
puter  interface;  (3)  to  develop  a  domain  model 
module  for  the  prototype;  (4)  to  develop  an  effective 
tutorial  module  to  guide  individualized  training 
processes;  and  (5)  to  develop  a  demonstrable  ITS 
prototype  in  the  field  of  Orbital  Dynamics  as  taught 
by  the  United  States  Air  Force  Academy  (USAFA). 
The  prototype  teaches  about  25  hours  of  the  cur¬ 
riculum  for  Block  I  of  Orbital  Mechanics.  A  second- 
generation  system,  currently  in  the  planning  stage, 


will  add  authoring  tools  to  allow  ITS  development  by 
on-site  training  development  personnel  at  the 
Academy. 

PLANNED  USERS:  ATC/XPC,  ATC/STS,  USAFA. 

CONTACT:  Maj  James  Parlett 

AFHRL/IDI 

Brooks  AFB  TX  78235-5601 

Commercial  (512)  536-2981 

AUTOVON  240-2981 

4.  Microcomputer  Intelligence  for  Technical 
Training  (MITT).  Course  authoring  systems  that  can 
be  run  on  microcomputers  do  not  have  artificial 
intelligence  capabilities.  Techniques  that  would 
permit  the  use  of  microcomputers  to  develop  tutor¬ 
ing  systems  with  artificial  intelligence  capabilities 
are  now  being  explored  by  AFHRL  During  FY  88, 
the  Laboratory  used  a  preliminary  version  of  MITT 
to  develop  a  shuttle  fuel  cell  tutoring  system  with 
artificial-intelligence-based  student  guidance  sys¬ 
tems  for  NASA.  The  next  phase  of  the  MITT  program 
will  involve  its  experimental  use  at  an  ATC  technical 
training  center. 

PLANNED  USERS:  NASA/JSC;  ATC/XPCR. 

CONTACT:  Capt  Kevin  Kline 

AFHRL/IDI 

Brooks  AFB  TX  78235-5601 

Commercial  (512)  536-2981 

AUTOVON  240-2981 

5.  Advanced  Visual  Technology  System  (AVTS). 
The  AVTS  project  was  closed  out  in  FY  88.  The 
AVTS  computer  image  generator  (CIG)  was 
designed  to  provide  visual  out-the-windowand  mul¬ 
tisensor  imagery  for  the  full  spectrum  of  tactical  air 
missions.  This  includes  air-to-surface  weapons 
delivery,  low-level  flight,  acquisition  of  surface-to-air 
missiles,  evasive  maneuvers,  and  normal  flight 
operations  such  as  takeoff,  landing,  and  aerial 
refueling.  The  CIG  hardware  and  software  are  com¬ 
patible  with  different  types  of  display  systems  and 
provide  high  quality,  realistic  imagery  for  combat 
simulations.  A  data  processing  technique  called 
"area  processing"  reduces  the  amount  of  computer 
hardware  required  and  overcomes  technical  limits 
of  other  CIG  systems.  This  technology  is  being 
marketed  under  the  trade  name  Compus cene  IV  by 
General  Electric.  Another  product  of  this  AVTS  ef¬ 
fort  is  a  high-resolution,  limited-field-of-view  dome 
visual  display  originally  developed  for  evaluation  of 
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nap-of-the-earth  Army  helicopter  training  effective¬ 
ness.  The  helicopter  cockpit  has  now  been 
replaced  by  an  F-16A  to  be  used  in  high-speed, 
low-altitude  flight  training  effectiveness  R&D  and 
air-to-air  and  air-to-ground  combat  studies.  AVTS 
also  provides  imagery  to  an  A-10  tactical  research 
simulator  and  a  visual  imagery  test  bed  facility. 

PLANNED  USER:  ASD. 

CONTACT:  Mr.  Steve  Stephens 

AFHRUOTA 

WILLIAMS  AZ  85240-6457 

Commercial  (602)988-6561 

AUTOVON  474-6561 

6.  C-130  Visual  Requirements.  Two  studies  were 
conducted  concerning  field-of-view  (FOV)  require¬ 
ments  for  C-130  weapon  system  trainers  at  Little 
Rock  AFB  AR.  The  first  study  investigated  the  ef¬ 
fects  of  eliminating  peripheral  visual  information  on 
assault  landings  using  experienced  C-130  pilots. 
The  results  indicated  no  adverse  effects  for  this  task. 
The  second  study  investigated  the  effects  of 
eliminating  peripheral  visual  information  on  low- 
level  navigation  and  air  drop  maneuvers.  Pilot  eye 
position  was  also  monitored.  The  results  indicated 
that  pilots  could  still  perform  the  task  without  the 
peripheral  windows  but  that  they  adopted  a  different 
visual  behavior  pattern  in  order  to  do  so.  A  third 
study  involved  scene  content  and  investigated  the 
effects  of  enhanced  detail  (texture  patterns  and 
vertical  development)  on  performance  of  assault 
landings.  The  results  indicated  enhanced  perfor¬ 
mance  in  the  high  scene  detail  condition. 

PLANNED  USERS:  MAC,  ASD. 

CONTACT:  Dr.  Elizabeth  Martin 

AFHRL/OTE 

Williams  AFB  AZ  85240-6561 

Commrcial  (602)  988-6561 

AUTOVON  474-  6561 

7.  Job  Performance  Measurement  Systems 
(JPMS).  AFHRL  developed  job  performance  meas¬ 
urement  instruments  in  response  to  a  Congres¬ 
sional  mandate  that  the  Services  establish  valid 
linkages  between  job  performance,  enlistment 
standards,  and  training  results.  ATC  and  AFMr 
also  have  requested  that  AFHRL  work  on  JPMS. 
The  JPMS  incorporates  a  variety  of  different  types 
of  instruments  for  measuring  job  performance;  they 


include  hands-on  measures,  interview  techniques, 
written  tests,  and  rating  forms.  Under  the  Joint-Ser¬ 
vice  Job  Performance  Measurement  Project,  the 
performance  measurement  technology  was  used  to 
collect  accurate  information  about  the  performance 
of  first-term  airmen.  They  were  selected  from  career 
fields  representative  of  the  major  aptitude  areas  of 
the  Armed  Services  Vocational  Aptitude  Battery. 
Measurement  instruments  were  developed  and 
data  collected  for  eight  Air  Force  enlisted  special¬ 
ties.  The  job  performance  measurement  technol¬ 
ogy  and  information  collected  is  being  assessed  for 
its  usefulness  in  evaluating  training  programs. 

PLANNED  USERS:  HQ  ATC,  AFMPC,  MAJCOM. 

CONTACT:  Capt  Martin  Pellum 

AFHRLVIDE 

Brooks  AFB  TX  78235-5601 

Commercial  (512)  536-2932 

AUTOVON  240-  2932 

8.  Guidelines  for  Range  System  Development.  A 
series  of  experiments  examined  the  effects  of  fac¬ 
tors  such  as  real-time  and  post-mission  feedback 
capabilities  on  the  effectiveness  of  electronic  com¬ 
bat  (EC)  training  systems.  The  findings  from  these 
experiments  are:  (a)  Simple  emitter  systems  cannot 
support  effective  countermeasures  training  or  pro¬ 
vide  real-time  feedback;  (b)  providing  accurate 
post-mission  feedback  can  compensate  to  a  great 
degree  for  lack  of  real-time  interaction,  but  the  lack 
of  such  interaction  may  affect  the  types  and  timing 
of  countermeasures  employed;  (c)  significant 
degradation  in  EC  performance  occurs  over  a  4-  to 
6-month  period,  with  the  amount  of  loss  being  af¬ 
fected  by  the  level  of  prior  proficiency  and  the 
amount  of  prior  training;  and  (d)  significant  transfer 
of  training  from  the  flight  simulator  to  the  aircraft 
occurs,  as  seen  in  more  frequent  use  of  counter¬ 
measures  on  early  exercise  sorties,  These  results 
provide  some  guidelines  for  the  development  of 
future  range  systems.  In  addition,  they  serve  as  a 
training  point  for  an  investigation  into  the  integration 
of  the  spectrum  of  training  devices  to  produce  an 
optimal  EC  training  program. 

PLANNED  USERS:  MSD/YI. 

CONTACT:  Dr.  Philip  Bruce 

AFHRL70TU 

Williams  AFB  AZ  85240-6561 

Comercial  (602)  988-6561 

AUTOVON  474-6561 
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APPENDIX  A:  CUSTOMER  REQUIREMENTS1 


Rqmt  No 

Rqmt  Title 

USER(S) 

AFR  30-23 

The  Air  Force  Personnel  Survey  Program 

N/A 

AFR  33-6 

Armed  Forces  Vocational  Testing  Program 

N/A 

AFR  35-2 

Occupational  Analysis 

N/A 

AFR  35-8 

Air  Force  Military  Personnel  Testing  System 

N/A 

RPR  80-01 

Basic  Job  Skills 

USAF/LEY/DPP 

TAC/CV/LG 

RPR  80-03 

Advanced  OJT  Management  and  Delivery  System 

USAF/DPPE 

AFMPC/DPMRPQ3 

RPR  81-06 

Validation  of  Civilian  Employee  Selection 
Procedures 

DPCO/MPK 

RPR  81-09 

Euro-NATO  Joint  Jet  Pilot  Training 

USAF/DPPTF 

USAF/XOOTD 

RPR  82-08 

Officer  Data  Base/Cohort  File 

USAF/DPAC 

RPR  83-02 

Improved  Performance  Measurement  and 
Prediction 

AFMPC/DPCRPQ 

RPR  83-24 

Improved  Selection  Procedures  for  Air  Force 
Physicians 

AFMPC/SGEP 

USAF/DPXA 

USAF/DPXOP 

RPR  84-02 

Contingency  Task  Training  Requirements 

ATC\XPRR 

USAFOMC/OMY 

RPR  85-01 

Expansion  of  Person-Job-Match  Technology 

AFMPC/DPCRPQ 

ATC/XPRR 

AFRS/RSMC 

RPR  85-02 

Quantifying  Experience  in  the  Cost  of  Human 
Capital 

AF/DPXA 

RPR  8513 

Non-Line  Officer  Projection  Model 

AF/DPXA 

AFMPC/SGPY 

AF/DPXOP 

’The  Requests  for  Personnel  Research  (RPRs),  Logistics  Research  Needs  (LNs),  and  Technology  Needs 
(TNs)  listed  in  this  Appendix  will  be  replaced  with  a  new  system  of  Manpower,  Personnel,  and  Training  Needs 
(MPTNs).  More  than  70  new  MPTNs  have  been  proposed  by  AFHRL  customers.  Many  will  be  in  next  year's 
R&T  Plan  as  documented  R&D  requirements. 
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Appendix  A  (Concluded) 


RPR  86-03 

PJM  Methodology 

AFMPC/DPMRAS4 

RPR  86-05 

Nonrated  Officer  Selection  System 

ATC/XPRR/RSCX 

USAFRS/RSMM 

LN  79014 

Trade-Offs  Among  Training  Manpower,  Automatic 

Test  Equipment,  and  Technical  Data 

AFALD 

LN  81022 

Automated  Decision  Aid  for  Aircraft  Battle  Damage 
Assessment 

AFCOLR 

AFLC/XRXX 

AFLC/XRS 

LN  81155 

Bio/Chem  Warfare  Effects  on  Aircraft  Battle 
Damage  Repair  and  Maintenance 

ABDR  AFALD/ERET 

LN  84054 

Maintenance  Air  Force  Specialty  Code  Compres¬ 
sion 

AFALD/XRS 

LN  84081 

Reliability  and  Maintainability  in  CAD 

HQ  AFSC/PLEL 

LN  85003 

Remote  Fault  Isolation  LRU  Functional  Tester 

AFLMC/LGM 

LN  85018 

Flightiine  Digital  Diagnostics  and  Tech  Data 

AD/ALP 

LN  85023 

R&M  Requirements  Determination 

AFALD/ERR 

LN  87031 

Fully  Automated  Acft  Maintenance  Data  Collection 

HQ  SAC/LGME 

LN  87077 

Determine  Skills/Abilities  of  Future  AF  Personnel 

ESD/DLLT 

LN  88071 

Advanced  Training  System  for  Logistics 

USAF/LGXI 

TN  ASD-0508-82-65 

Image  Generation  for  Flight  Simulator  Visual 
System 

ASD/EN 

TN  ASD-1 705-77-642 

Ground  Mapping  Radar  Simulation 

ASD/EN 

TN  ASD-0509-82-63 

Right  Simulator  Performance  Metrics 

ASD/EN/YWE 

TN  ASD-0508-82-66 

Visual  System  Display 

ASD/EN 
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APPENDIX  B:  FUNDING  ($M) 


Program 

Element 

Title 

Actual 

FY  88 

Actual 

FY  89 

Est 

FY  90 

Est 

FY  91 

61101F 

LDIRP 

0.9 

.4 

.4 

.4 

61102F 

Defense  Research  Sci 

1.0 

1.0 

1.2 

1.2 

62205 F 

Tmg  &  Sim  Tech 

30.9 

30.5 

29.0 

29.0 

631 06F 

Log  Sys  Tec 

8.3 

13.7 

9.6 

13.5 

63227F 

Adv  Sim  Tech 

7.5 

8.2 

7.8 

9.0 

63751 F 

Tmg  Sys  Tech 

0.3 

0.5 

0 

0 

TOTAL 

48.9 

54.3 

48.0 

53.1 

FUNDS  RECEIVED  FROM  OTHER  SOURCES  (FY  89) 

As  of  30  Sep  89  a  total  of  $4.4M  was  received  from  other  sources 

to  support  R&D  programs  of 

mutual  interest. 

Laboratory  Operations 

FY  88 

FY  89 

FY  90 

FY  91 

6.1 

.4 

.3 

.4 

.4 

6.2 

10.4 

10.8 

11.8 

11.9 

6.3 

1.7 

1.6 

1.7 

1.8 

TOTAL 

12.5 

12.7 

13.9 

14.1 
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APPENDIX  C:  MANPOWER 

NUMBER  AUTHORIZED  FOR  FY  89:2 


OFFICERS  95  ENLISTED 

93 

CIVILIAN  211 

TOTAL: 

399 

PROFESSIONAL  CATEGORY: 

Officers 

Enlisted 

Civilian 

Total 

Scientific  &  Engineering  (S&E) 

88 

0 

113 

201 

Technical 

5 

68 

37 

110 

Other 

_2 

25 

61 

88 

TOTAL 

95 

93 

211 

399 

ACADEMIC  DEGREES: 

Bachelors 

Masters 

PhDs 

Total 

Psych/Human  Factors 

25 

33 

35 

93 

Computer  Sci/lnfo  Sci/Math 

23 

10 

3 

36 

Engineering 

31 

8 

0 

39 

Business  Adm/Management  Sci 

10 

19 

2 

31 

Education 

5 

3 

4 

12 

Other 

10 

U 

_3 

24 

TOTAL 

104 

84 

47 

235 

Authorized  personnel  decreased  by  1  in  FY  88,  and  4  in  FY  89. 
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APPENDIX  D:  FACILITIES 


An  annex  to  Bldg  578  was  completed  in  January  1 990,  and  contains  2,870  square  feet.  It  will  be  occupied 
jointly  by  the  Manpower  and  Personnel  Division  and  the  Training  Systems  Division.  Present  facilities  are  as 
described  below. 


Square  Footage 

Facility($K) 

S&E  Equip($K) 

Brooks  AFB  TX--2  Bldgs 

75,260 

2,483 

4,681 

Bldg  578: 

Laboratory  HQ 

Manpower  &  Personnel  Division 
Information  Sciences  Division 

Training  Systems  Division 

73,640 

Bldg  1 155--Archives 

1,620 

Lackland  AFB  TX--3  Bldgs 

12,706 

440 

2,500 

Bldg  9016-Testing  Facility 

Bldg  6321  -Paper-and-Pencil  Testing 

7,986 

4,720 

(Built  1951) 
(Built  1941) 

Wright-Patterson  AFB  OH-2  Bldg 

Logistics  &  Human  Factors  Division 

33,150 

548 

1,981 

Bldg  190-AFHRL  LR  Personnel 

Bldg  434-Contract  Personnel 

21,600 

11,550 

Williams  AFB  AZ-  9  Bldg 

Operations  Training  Division 

88,572 

11,728 

107,616 

Bldg  551 -Administration  &  Computers 

Bldg  552-LMCA  Administration  Supply  Facility 
Bldg  554-Administration  &  Computers 

Bldg  558-ASPT  Cockpits 

Bldg  560  PDT  Lab.  UNI  VAC  1 108 

Bldg  561  -Aircrew  Training  Research  Facility 
Bldg  562-Engineering  Support 

Bldg  567-Administration  &  Computers 

Bldg  570-Simulator/Research  Facility 

2,200 

1,647 

2,200 

22,485 

9,600 

30,660 

4.200 

2.200 

13,380 

Luke  AFB  A Z -2  Bldgs 

Air-To-Air  Combat  R&D 

3,060 

Bldg  616-Contract  Personnel 

Bldg  617-Contract  Personnel 

2,760 

300 

TOTAL:  20  Bldg 

222,278  sq  ft 
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